Oct 31 07:28:35.935264 ip-10-0-140-145 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 07:28:36.335500 ip-10-0-140-145 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:36.335500 ip-10-0-140-145 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 07:28:36.335500 ip-10-0-140-145 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:36.335500 ip-10-0-140-145 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:36.340028 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.339927    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.340028 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340029    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340034    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340037    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340040    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340043    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340046    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340049    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340052    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340055    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340057    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340060    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340063    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340065    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340068    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340071    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340073    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340076    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340084    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340088    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340091    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.340100 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340093    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340096    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340099    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340101    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340105    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340108    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340111    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340114    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340116    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340121    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340126    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340130    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340133    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340135    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340138    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340141    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340143    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340146    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340149    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.340563 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340151    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340154    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340156    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340159    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340162    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340165    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340167    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340170    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340173    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340175    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340178    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340181    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340183    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340186    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340188    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340192    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340195    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340198    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340200    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340203    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.341059 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340205    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340208    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340210    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340213    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340215    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340218    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340220    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340223    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340225    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340228    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340230    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340233    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340235    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340238    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340241    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340243    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340246    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340249    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340251    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340254    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.341529 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340256    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340259    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340261    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340264    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340267    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340270    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340272    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340276    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340279    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340282    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340286    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340290    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340294    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340297    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340299    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340302    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340304    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340307    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340310    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.342036 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340312    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340315    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340317    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340320    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340323    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340325    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.340328    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341172    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341180    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341184    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341187    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341191    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341194    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341196    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341199    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341203    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341207    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341210    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341214    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.342501 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341217    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341221    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341225    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341228    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341231    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341234    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341237    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341240    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341242    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341245    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341248    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341251    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341253    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341256    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341258    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341261    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341264    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341266    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341269    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341271    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.342953 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341274    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341277    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341279    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341282    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341284    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341287    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341290    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341292    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341295    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341297    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341300    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341302    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341307    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341312    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341316    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341319    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341321    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341324    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341328    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.343439 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341330    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341333    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341335    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341338    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341340    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341343    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341345    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341348    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341350    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341353    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341355    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341359    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341361    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341364    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341367    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341369    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341372    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341374    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341376    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341379    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.343903 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341382    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341384    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341387    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341389    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341392    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341394    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341399    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341402    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341404    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341407    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341410    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341412    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341415    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341417    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341420    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341423    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341425    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341428    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341430    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341433    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.344393 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341435    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341438    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341441    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341443    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341447    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341450    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341452    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341455    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341457    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341460    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341462    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341465    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341467    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341470    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341472    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.341995    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342001    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342004    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342009    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.344896 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342012    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342014    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342017    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342020    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342022    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342025    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342028    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342031    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342033    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342036    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342039    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342042    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342045    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342048    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342050    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342053    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342055    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342058    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342061    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342063    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.345349 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342066    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342069    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342071    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342074    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342076    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342079    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342082    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342085    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342087    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342090    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342093    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342096    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342099    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342102    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342105    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342108    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342110    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342113    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342116    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342118    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.345813 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342121    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342123    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342126    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342129    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342131    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342134    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342136    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342139    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342141    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342144    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342147    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342149    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342151    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342154    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342157    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342159    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342161    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342164    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342167    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342169    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.346297 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342172    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342174    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342178    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342182    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342185    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342188    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342191    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342194    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342196    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342199    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342202    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342205    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342207    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342210    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342212    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342215    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342217    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342220    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342222    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.346761 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342225    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342227    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342230    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342233    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342235    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342238    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342240    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342243    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342245    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342248    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342251    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342255    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342258    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342261    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342265    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342268    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342273    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342276    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342279    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342282    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.347215 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342284    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342287    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.342290    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343301    2576 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343311    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343318    2576 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343322    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343327    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343330    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343335    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343339    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343343    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343346    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343350    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343353    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343357    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343360    2576 flags.go:64] FLAG: --cgroup-root=""
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343363    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343367    2576 flags.go:64] FLAG: --client-ca-file=""
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343370    2576 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343373    2576 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343379    2576 flags.go:64] FLAG: --cluster-domain=""
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343382    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 07:28:36.347674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343385    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343389    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343392    2576 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343397    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343400    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343404    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343407    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343411    2576 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343414    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343418    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343421    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343425    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343430    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343433    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343436    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343440    2576 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343443    2576 flags.go:64] FLAG: --enable-server="true"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343447    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343451    2576 flags.go:64] FLAG: --event-burst="100"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343455    2576 flags.go:64] FLAG: --event-qps="50"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343458    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343461    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343464    2576 flags.go:64] FLAG: --eviction-hard=""
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343469    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 07:28:36.348249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343472    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343477    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343481    2576 flags.go:64] FLAG: --eviction-soft=""
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343484    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343487    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343490    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343493    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343496    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343499    2576 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343502    2576 flags.go:64] FLAG: --feature-gates=""
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343507    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343509    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343513    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343516    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343520    2576 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343523    2576 flags.go:64] FLAG: --help="false"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343526    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343529    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343533    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343536    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343540    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343543    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343546    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 07:28:36.348872 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343549    2576 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343552    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343555    2576 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343558    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343561    2576 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343564    2576 flags.go:64] FLAG: --kube-reserved=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343567    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343570    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343573    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343576    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343580    2576 flags.go:64] FLAG: --lock-file=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343583    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343586    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343589    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343595    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343599    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343602    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343605    2576 flags.go:64] FLAG: --logging-format="text"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343609    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343612    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343615    2576 flags.go:64] FLAG: --manifest-url=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343618    2576 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343623    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343626    2576 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343630    2576 flags.go:64] FLAG: --max-pods="110"
Oct 31 07:28:36.349445 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343634    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343637    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343640    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343649    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343652    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343655    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343658    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343666    2576 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343670    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343673    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343676    2576 flags.go:64] FLAG: --pod-cidr=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343679    2576 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343683    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343686    2576 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343689    2576 flags.go:64] FLAG: --port="10250"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343692    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343695    2576 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0e3138f70ce03c146"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343700    2576 flags.go:64] FLAG: --qos-reserved=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343703    2576 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343706    2576 flags.go:64] FLAG: --register-node="true"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343709    2576 flags.go:64] FLAG: --register-with-taints=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343716    2576 flags.go:64] FLAG: --registry-burst="10"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343719    2576 flags.go:64] FLAG: --registry-qps="5"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343722    2576 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343725    2576 flags.go:64] FLAG: --reserved-memory=""
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343729    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 07:28:36.350108 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343733    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343736    2576 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343739    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343742    2576 flags.go:64] FLAG: --runonce="false"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343745    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343748    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343751    2576 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343755    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343758    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343761    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343764    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343768    2576 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343771    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343774    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343777    2576 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343780    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343794    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343798    2576 flags.go:64] FLAG: --system-cgroups=""
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343800    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343806    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343809    2576 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343813    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343818    2576 flags.go:64] FLAG: --tls-min-version=""
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343824    2576 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343827    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 07:28:36.350749 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343830    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343833    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343841    2576 flags.go:64] FLAG: --v="2"
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343845    2576 flags.go:64] FLAG: --version="false"
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343850    2576 flags.go:64] FLAG: --vmodule=""
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343854    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.343857    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344048    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344053    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344056    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344060    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344062    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344065    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344068    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344071    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344073    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344076    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344079    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344082    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344085    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344088    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.351350 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344090    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344093    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344096    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344099    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344102    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344104    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344107    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344109    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344112    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344116    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344118    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344121    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344124    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344128    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344131    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344133    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344136    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344139    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344141    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344144    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.351845 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344147    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344149    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344152    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344154    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344157    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344160    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344162    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344165    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344168    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344170    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344173    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344176    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344179    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344181    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344184    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344186    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344189    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344191    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344194    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344197    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.352341 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344199    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344203    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344206    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344209    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344211    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344215    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344218    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344220    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344223    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344226    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344228    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344231    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344233    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344236    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344238    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344242    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344246    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344249    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344252    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344255    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.352811 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344258    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344261    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344263    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344267    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344270    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344273    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344275    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344278    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344280    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344283    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344285    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344288    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344291    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344295    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344297    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344300    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344303    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344306    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344309    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344312    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.353347 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344314    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344317    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344320    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344322    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344325    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344328    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344331    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344333    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344336    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344338    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344342    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344346    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.344372    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344414    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344418    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344421    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.353852 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344424    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344427    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344430    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344432    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344435    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344438    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344440    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344443    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344446    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344448    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344452    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344454    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344459    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344464    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344467    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344470    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344474    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344477    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344480    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.354247 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344482    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344485    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344488    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344490    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344493    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344495    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344498    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344501    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344503    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344506    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344508    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344511    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344513    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344516    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344519    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344522    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344524    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344527    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344529    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344532    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.354692 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344534    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344537    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344540    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344542    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344545    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344548    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344552    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344554    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344559    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344562    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344566    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344569    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344573    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344576    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344579    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344581    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344584    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344586    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344589    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.355267 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344592    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344595    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344597    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344600    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344602    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344605    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344607    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344610    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344613    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344616    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344619    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344621    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344624    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344626    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344629    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344632    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344635    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344637    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344640    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.355717 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344644    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344647    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344650    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344652    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344655    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344657    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344660    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344663    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344665    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344668    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344673    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344676    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344679    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344681    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344685    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344688    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344690    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344693    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344695    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344698    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.356203 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344700    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344703    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344706    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344709    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344711    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.344713    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.351722    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.351871    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.352609    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.352616    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352679    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352684    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352688    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352691    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352694    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352697    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352700    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352703    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352705    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.356694 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352708    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352711    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352713    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352716    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352719    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352721    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352724    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352727    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352730    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352733    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352736    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352738    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352741    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352743    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352746    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352749    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352752    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352754    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352757    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.357163 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352760    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352763    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352766    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352769    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352771    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352774    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352776    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352779    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352783    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352787    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352792    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352795    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352798    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352801    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352805    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352809    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352812    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352815    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352818    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.357618 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352821    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352823    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352826    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352829    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352832    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352835    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352838    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352841    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352843    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352846    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352848    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352851    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352854    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352857    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352860    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352862    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352865    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352868    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352871    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352874    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.358075 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352876    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352879    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352882    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352884    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352887    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352889    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352892    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352895    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352897    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352900    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352902    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352905    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352908    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352910    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352913    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352915    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352919    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352921    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352924    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352926    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.358536 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352929    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352932    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352935    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352937    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352940    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352943    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352946    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352949    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352951    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352954    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352956    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352959    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352961    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352978    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352982    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352984    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352987    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352989    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.359197 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.352992    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.353021    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353166    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353170    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353174    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353176    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353179    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353182    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353184    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353187    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353189    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353192    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353195    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353198    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353200    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353203    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.359862 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353205    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353208    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353211    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353213    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353216    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353219    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353221    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353224    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353227    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353229    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353233    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353237    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353241    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353244    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353247    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353250    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353253    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353255    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353258    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353260    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.360413 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353263    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353265    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353268    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353271    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353273    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353275    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353279    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353283    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353286    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353289    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353291    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353294    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353297    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353300    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353303    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353306    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353309    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353311    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353314    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.360890 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353316    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353319    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353321    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353324    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353326    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353329    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353331    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353334    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353336    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353339    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353341    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353344    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353346    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353349    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353351    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353354    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353357    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353359    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353362    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.361398 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353365    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353367    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353370    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353373    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353376    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353379    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353381    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353384    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353387    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353389    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353392    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353394    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353397    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353399    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353402    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353404    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353407    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353409    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353412    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353414    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.361846 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353417    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353420    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353422    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353426    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353428    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353431    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353433    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353436    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353438    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353441    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353443    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353446    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353449    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353451    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.353473    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:36.362334 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353504    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353509    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353513    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353516    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353518    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353521    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353524    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353526    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353529    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353531    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353534    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353536    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353539    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353542    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353544    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353547    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353550    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353552    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353555    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:36.362686 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353558    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353560    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353562    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353565    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353568    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353570    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353573    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353575    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353578    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353580    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353583    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353585    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353588    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353590    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353592    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353596    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353599    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353601    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353604    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353606    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:36.363148 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353609    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353612    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353615    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353619    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353622    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353625    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353628    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353631    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353634    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353636    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353640    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353642    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353645    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353648    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353650    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353653    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353656    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353658    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353662    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:36.363612 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353666    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353669    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353671    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353674    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353677    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353680    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353683    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353685    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353688    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353691    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353693    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353696    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353699    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353701    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353704    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353706    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353709    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353711    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353714    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353716    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:36.364064 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353719    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353721    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353724    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353726    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353729    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353731    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353734    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353736    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353739    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353741    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353744    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353746    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353749    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353752    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353755    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353757    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353760    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353763    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353765    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:36.364542 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353768    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353770    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353773    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353776    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353779    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353781    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353784    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353786    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:36.353789    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.353844    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.356269    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.357294    2576 server.go:1014] "Starting client certificate rotation"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.357391    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.357431    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.361054    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:28:36.365098 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.364374    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:28:36.375489 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.375467    2576 log.go:25] "Validated CRI v1 runtime API"
Oct 31 07:28:36.379476 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.379461    2576 log.go:25] "Validated CRI v1 image API"
Oct 31 07:28:36.380316 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.380284    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 07:28:36.385277 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.385255    2576 fs.go:135] Filesystem UUIDs: map[56f6dd62-26aa-4f3a-9f58-01d2db616af1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 89f1d931-6eb5-4e12-ae07-87422132c464:/dev/nvme0n1p3]
Oct 31 07:28:36.385341 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.385275    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 07:28:36.391369 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.391257    2576 manager.go:217] Machine: {Timestamp:2026-10-31 07:28:36.389036914 +0000 UTC m=+0.354260348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100940 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ba1e0c49d3c5d8ec052cda4ee39d SystemUUID:ec20ba1e-0c49-d3c5-d8ec-052cda4ee39d BootID:e5f51930-9b2a-48aa-a6a6-49759586546f Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:63:3f:89:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:63:3f:89:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:7a:94:1d:88:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 07:28:36.391450 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.391372    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 07:28:36.391499 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.391487    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 07:28:36.392626 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392587    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 07:28:36.392760 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392614    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-145.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 07:28:36.392802 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392766    2576 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 07:28:36.392802 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392774    2576 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 07:28:36.392802 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392799    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:28:36.392882 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.392812    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:28:36.394109 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.394099    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 07:28:36.398649 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.398637    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 07:28:36.398923 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.398913    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 07:28:36.399745 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.399735    2576 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 07:28:36.399813 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.399748    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 07:28:36.399813 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.399760    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 07:28:36.399813 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.399770    2576 kubelet.go:405] "Adding apiserver pod source"
Oct 31 07:28:36.399813 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.399778    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 07:28:36.400238 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.400210    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:28:36.402569 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.402544    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 07:28:36.410363 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.410349    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:28:36.411299 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411287    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 07:28:36.411345 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411317    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 07:28:36.411483 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411464    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 07:28:36.411483 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411480    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 07:28:36.411483 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411487    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 07:28:36.411621 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411493    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 07:28:36.411621 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411500    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 07:28:36.411621 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.411506    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 07:28:36.412156 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412147    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 07:28:36.412156 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412156    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 07:28:36.412218 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412164    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 07:28:36.412218 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412171    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 07:28:36.412218 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412179    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 07:28:36.412218 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.412188    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 07:28:36.413703 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.413693    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 07:28:36.413703 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.413703    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 07:28:36.417511 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.417495    2576 server.go:1263] "Started kubelet"
Oct 31 07:28:36.421152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.417696    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 07:28:36.421296 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.417686    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 07:28:36.421359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.421329    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 07:28:36.422107 ip-10-0-140-145 systemd[1]: Started Kubernetes Kubelet.
Oct 31 07:28:36.425720 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.425701    2576 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 07:28:36.426900 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.426882    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 07:28:36.428653 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.428632    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 07:28:36.432700 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.432682    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 07:28:36.433272 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.433259    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 07:28:36.433551 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.433526    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:36.434156 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434138    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 07:28:36.434256 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434140    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 07:28:36.434256 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434202    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 07:28:36.434256 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434219    2576 factory.go:55] Registering systemd factory
Oct 31 07:28:36.434256 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434228    2576 factory.go:223] Registration of the systemd container factory successfully
Oct 31 07:28:36.434616 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434595    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 07:28:36.434708 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434637    2576 factory.go:153] Registering CRI-O factory
Oct 31 07:28:36.434708 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434653    2576 factory.go:223] Registration of the crio container factory successfully
Oct 31 07:28:36.434708 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434683    2576 factory.go:103] Registering Raw factory
Oct 31 07:28:36.434708 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434692    2576 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 07:28:36.434708 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434704    2576 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 07:28:36.434875 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.434698    2576 manager.go:1199] Started watching for new ooms in manager
Oct 31 07:28:36.435717 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.435701    2576 manager.go:319] Starting recovery of all containers
Oct 31 07:28:36.443803 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.443788    2576 manager.go:324] Recovery completed
Oct 31 07:28:36.447438 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.447422    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.449674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.449652    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.449756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.449686    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.449756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.449702    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.450742 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.450725    2576 cpu_manager.go:226] "Starting" policy="none"
Oct 31 07:28:36.450742 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.450739    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 07:28:36.450866 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.450746    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.450866 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.450760    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 07:28:36.451456 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.451440    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.451532 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.451461    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.451532 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.451472    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.452935 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.452920    2576 policy_none.go:50] "Start"
Oct 31 07:28:36.452935 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.452937    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 07:28:36.453061 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.452956    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 07:28:36.454923 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.454910    2576 policy_none.go:44] "Start"
Oct 31 07:28:36.494565 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.494531    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 07:28:36.497163 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497131    2576 manager.go:341] "Starting Device Plugin manager"
Oct 31 07:28:36.497255 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.497192    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 07:28:36.497255 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497234    2576 server.go:87] "Starting device plugin registration server"
Oct 31 07:28:36.497613 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497598    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 07:28:36.497670 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497616    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 07:28:36.498430 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497821    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 07:28:36.498430 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497901    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 07:28:36.498430 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.497909    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 07:28:36.498430 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.498362    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 07:28:36.498430 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.498405    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:36.549568 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.549538    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 07:28:36.551614 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.550653    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 07:28:36.551614 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.550669    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 07:28:36.551614 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.550688    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 07:28:36.551614 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.550719    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 07:28:36.553824 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.553658    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-145.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 07:28:36.553824 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.553662    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-145.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 07:28:36.554426 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.553673    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-145.us-west-1.compute.internal.18e38ca4e1fb7164  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-145.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-145.us-west-1.compute.internal,},FirstTimestamp:2026-10-31 07:28:36.417466724 +0000 UTC m=+0.382690158,LastTimestamp:2026-10-31 07:28:36.417466724 +0000 UTC m=+0.382690158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-145.us-west-1.compute.internal,}"
Oct 31 07:28:36.598248 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.598155    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.599137 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.599118    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.599248 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.599148    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.599248 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.599161    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.599248 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.599187    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.607798 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.607762    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 31 07:28:36.607798 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.607769    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 31 07:28:36.608014 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.607754    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-145.us-west-1.compute.internal.18e38ca4e3e6dcea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-145.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-145.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-145.us-west-1.compute.internal,},FirstTimestamp:2026-10-31 07:28:36.449672426 +0000 UTC m=+0.414895867,LastTimestamp:2026-10-31 07:28:36.449672426 +0000 UTC m=+0.414895867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-145.us-west-1.compute.internal,}"
Oct 31 07:28:36.608014 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.607926    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-145.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 07:28:36.636648 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.636625    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 07:28:36.636726 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.636685    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7mmk6"
Oct 31 07:28:36.651709 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.651683    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"]
Oct 31 07:28:36.651798 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.651758    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.652668 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.652654    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.652752 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.652686    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.652752 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.652700    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.654981 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.654956    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.655112 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.655159 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655129    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.655660 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655646    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.655660 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655653    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.655753 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655675    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.655753 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655687    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.655753 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655676    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.655853 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.655771    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.657787 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.657773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.657787 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.657798    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:36.658562 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.658548    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:36.658612 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.658575    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:36.658612 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.658585    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:36.689753 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.689717    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.692566 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.692549    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.707314 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.707298    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:36.713871 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.713850    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.713948 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.713875    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-145.us-west-1.compute.internal\": node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:36.736794 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.736763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.736901 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.736799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.736901 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.736818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.828859 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.828826    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:36.837151 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.837224 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.837224 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.837310 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.837310 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.837310 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.837242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.929475 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:36.929416    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:36.993610 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.993583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:36.995714 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:36.995697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:37.030494 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.030461    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.132423 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.132381    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.232822 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.232739    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.333205 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.333171    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.357593 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.357567    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 07:28:37.358070 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.357693    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 07:28:37.358070 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.357755    2576 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://adf9bd3603f5d4feb94c1d7340fbfba2-7a76273f21d70fcd.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-145.us-west-1.compute.internal.18e38ca4e3e72dda\": read tcp 10.0.140.145:57326->16.58.112.7:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-145.us-west-1.compute.internal.18e38ca4e3e72dda  default   5281 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-145.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-145.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-145.us-west-1.compute.internal,},FirstTimestamp:2026-10-31 07:28:36 +0000 UTC,LastTimestamp:2026-10-31 07:28:36.65269228 +0000 UTC m=+0.617915714,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-145.us-west-1.compute.internal,}"
Oct 31 07:28:37.434788 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.434756    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.535914 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.535837    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.579453 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.579427    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:37.580576 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.580560    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:37.580657 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.580592    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:37.580657 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.580605    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:28:37.636472 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.636450    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.641850 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.641826    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:23:37 +0000 UTC" deadline="2028-07-11 21:31:27.254917074 +0000 UTC"
Oct 31 07:28:37.641908 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.641851    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14870h2m49.613069148s"
Oct 31 07:28:37.736910 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.736879    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.833627 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.833546    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:37.838007 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.837986    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.938945 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:37.938914    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:37.940083 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:37.940070    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:38.039796 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.039618    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:38.112285 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.112253    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2d27ecaeaabe5b2e48a361bbe98176.slice/crio-c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653 WatchSource:0}: Error finding container c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653: Status 404 returned error can't find the container with id c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653
Oct 31 07:28:38.117169 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.117154    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:28:38.140289 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.140266    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:28:38.140636 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.140613    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8d2bd7442930f2267d92c4a39b2cf9.slice/crio-a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359 WatchSource:0}: Error finding container a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359: Status 404 returned error can't find the container with id a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359
Oct 31 07:28:38.146633 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.146615    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:38.234277 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.234235    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:38.302227 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.302198    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:38.303090 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.303076    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:28:38.363215 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.363146    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:38.401886 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.401862    2576 apiserver.go:52] "Watching apiserver"
Oct 31 07:28:38.435299 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.435273    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 07:28:38.513551 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.513524    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 07:28:38.513844 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.513825    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-j7x5v","kube-system/konnectivity-agent-rhw4q","openshift-multus/multus-additional-cni-plugins-7rdr6","openshift-network-operator/iptables-alerter-nlw2n","kube-system/global-pull-secret-syncer-mlgpz","kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal","openshift-image-registry/node-ca-65p5r","openshift-multus/multus-dpqwq","openshift-network-diagnostics/network-check-target-f6dr5","openshift-cluster-node-tuning-operator/tuned-blhz6","openshift-dns/node-resolver-xrmzc","openshift-ovn-kubernetes/ovnkube-node-t7mvb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"]
Oct 31 07:28:38.517747 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.517731    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:38.517868 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.517841    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:38.520057 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.520043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.522321 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.522301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.524676 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.524660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.527116 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.526952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.529520 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.529499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.529611 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.529574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:38.531828 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.531811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.534175 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.534156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.536608 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.536590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.536781 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.536655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:38.538945 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.538813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.541292 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.541272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.543643 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.543626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.547236 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.547354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.547354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.547354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:38.547354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4pv\" (UniqueName: \"kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlgw\" (UniqueName: \"kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.547537 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcszt\" (UniqueName: \"kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.547949 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.547982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.548283 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.548567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58prx\" (UniqueName: \"kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.548867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkt7w\" (UniqueName: \"kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4zw\" (UniqueName: \"kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.548986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.549254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.549202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.555335 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.555291    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"9d8d2bd7442930f2267d92c4a39b2cf9","Type":"ContainerStarted","Data":"a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359"}
Oct 31 07:28:38.557527 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.557492    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerStarted","Data":"c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653"}
Oct 31 07:28:38.576915 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.576897    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 07:28:38.595166 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.595149    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.595984 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.595929    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 07:28:38.595984 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.595940    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvmcp\""
Oct 31 07:28:38.595984 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.595917    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 07:28:38.596173 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.596071    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gttml\""
Oct 31 07:28:38.596173 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.596120    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jtbjn\""
Oct 31 07:28:38.598565 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.598551    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ldrdc\""
Oct 31 07:28:38.598629 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.598612    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46dh7\""
Oct 31 07:28:38.637167 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.637107    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 07:28:38.649431 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.649539 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.649539 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.649539 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649539 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649536    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649583    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649734 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649887    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.649938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58prx\" (UniqueName: \"kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.649997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650085    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.650294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkt7w\" (UniqueName: \"kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4zw\" (UniqueName: \"kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8grg\" (UniqueName: \"kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650614    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650653    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.650685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.650748    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650785    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zm74\" (UniqueName: \"kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.650810    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:39.15079028 +0000 UTC m=+3.116013718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650846    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650866    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650895    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.651165 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.650992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfgh\" (UniqueName: \"kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4pv\" (UniqueName: \"kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlgw\" (UniqueName: \"kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651290    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651302    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:38.651756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651380    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651407    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.651448    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651502    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.651535    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:39.151517646 +0000 UTC m=+3.116741089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651535    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651535    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652408 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651639    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651801    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcszt\" (UniqueName: \"kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.651998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652101    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 07:28:38.652967 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652128    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.653506 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.652354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.655740 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.655723    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.655824 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.655808    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.687492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687469    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.687623 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687594    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 07:28:38.687668 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687635    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.687668 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687660    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.687828 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687816    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 07:28:38.687911 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687823    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.687911 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687856    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688075 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.687992    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.688075 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688009    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.688075 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688016    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 07:28:38.688075 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688062    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688116    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688143    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688154    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688158    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688172    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688286 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688143    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688305    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 07:28:38.688492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688321    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 07:28:38.688492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688353    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 07:28:38.688492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688434    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 07:28:38.688492 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.688489    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 07:28:38.690272 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.690257    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.690343 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.690323    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.690381 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.690351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.690381 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.690323    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.690628 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.690613    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.692494 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.692474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.692540 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.692525    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.692694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.692673    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.692729 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.692685    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.704102 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.704080    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 07:28:38.704322 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.704308    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7fk4f\""
Oct 31 07:28:38.704387 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.704320    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w8pvl\""
Oct 31 07:28:38.704387 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.704320    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kwsqb\""
Oct 31 07:28:38.704387 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.704320    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-798mv\""
Oct 31 07:28:38.713198 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.713173    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4zw\" (UniqueName: \"kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.713198 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.713194    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58prx\" (UniqueName: \"kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.713322 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.713174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkt7w\" (UniqueName: \"kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:38.716891 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.716866    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:38.716891 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.716889    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:38.717034 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.716905    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:38.717034 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:38.716975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:28:39.216956347 +0000 UTC m=+3.182179771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:38.718405 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.718384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4pv\" (UniqueName: \"kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.718606 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.718587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlgw\" (UniqueName: \"kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.718685 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.718668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcszt\" (UniqueName: \"kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.745792 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.745770    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 07:28:38.745898 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.745812    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vjcm5"
Oct 31 07:28:38.753277 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.753359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753534    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753540    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.753555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8grg\" (UniqueName: \"kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753632    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753632    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753679    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm74\" (UniqueName: \"kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753800    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfgh\" (UniqueName: \"kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.753910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.754039    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.754743 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.754332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.756164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.756147    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.756280 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.756192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.815529 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.815501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8grg\" (UniqueName: \"kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.815640 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.815536    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfgh\" (UniqueName: \"kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.815640 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.815541    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zm74\" (UniqueName: \"kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.845717 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.845691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:38.855732 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.855708    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fe2da9_e59f_4b74_b99f_d1158fe8a08a.slice/crio-478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef WatchSource:0}: Error finding container 478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef: Status 404 returned error can't find the container with id 478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef
Oct 31 07:28:38.859127 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.859110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:28:38.861825 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.861810    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:38.865466 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.865451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dpqwq"
Oct 31 07:28:38.869616 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.869593    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbf450b_951d_4782_9f73_bcbe937a69b7.slice/crio-9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1 WatchSource:0}: Error finding container 9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1: Status 404 returned error can't find the container with id 9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1
Oct 31 07:28:38.871093 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.871070    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958faca4_910f_457f_8f09_ce70c47b6fed.slice/crio-58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde WatchSource:0}: Error finding container 58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde: Status 404 returned error can't find the container with id 58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde
Oct 31 07:28:38.875904 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.875882    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859bca1d_5fb6_4bac_9d0c_f9ab6ea99aab.slice/crio-f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966 WatchSource:0}: Error finding container f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966: Status 404 returned error can't find the container with id f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966
Oct 31 07:28:38.876009 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.875934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:28:38.879090 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.879075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:28:38.880873 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.880860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:28:38.883128 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.883109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:28:38.885499 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.885361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:28:38.886006 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.885985    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08cf711_53da_4c43_8ae1_8a39ea5cce48.slice/crio-6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3 WatchSource:0}: Error finding container 6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3: Status 404 returned error can't find the container with id 6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3
Oct 31 07:28:38.891939 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.891916    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc55e14_b1ff_4c2e_96c2_81fd385b3987.slice/crio-7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54 WatchSource:0}: Error finding container 7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54: Status 404 returned error can't find the container with id 7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54
Oct 31 07:28:38.893275 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.893249    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e2f3ab_4e74_4fcf_834f_76c10bb97f20.slice/crio-75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d WatchSource:0}: Error finding container 75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d: Status 404 returned error can't find the container with id 75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d
Oct 31 07:28:38.898038 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.898017    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d69252_ed4e_41a4_abc0_018958c37b4d.slice/crio-6b8f63288d71dbcf68cfe485f35a19efbd73515084ad62217dfe0dea429d8c2c WatchSource:0}: Error finding container 6b8f63288d71dbcf68cfe485f35a19efbd73515084ad62217dfe0dea429d8c2c: Status 404 returned error can't find the container with id 6b8f63288d71dbcf68cfe485f35a19efbd73515084ad62217dfe0dea429d8c2c
Oct 31 07:28:38.901544 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:28:38.901525    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570337d2_bd49_4f21_9f34_eb0a9111aa27.slice/crio-334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1 WatchSource:0}: Error finding container 334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1: Status 404 returned error can't find the container with id 334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1
Oct 31 07:28:38.949725 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:38.949692    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:39.155726 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.155638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:39.155726 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.155706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:39.155965 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.155843    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:39.155965 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.155847    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:39.155965 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.155906    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:40.155888279 +0000 UTC m=+4.121111704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:39.155965 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.155927    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:40.155916681 +0000 UTC m=+4.121140109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:39.256182 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.256140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:39.256407 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.256295    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:39.256407 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.256322    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:39.256407 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.256338    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:39.256578 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:39.256408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:28:40.256385146 +0000 UTC m=+4.221608585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:39.561877 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.561613    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blhz6" event={"ID":"24d69252-ed4e-41a4-abc0-018958c37b4d","Type":"ContainerStarted","Data":"6b8f63288d71dbcf68cfe485f35a19efbd73515084ad62217dfe0dea429d8c2c"}
Oct 31 07:28:39.563910 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.563878    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65p5r" event={"ID":"3fc55e14-b1ff-4c2e-96c2-81fd385b3987","Type":"ContainerStarted","Data":"7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54"}
Oct 31 07:28:39.568423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.565174    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh" event={"ID":"e08cf711-53da-4c43-8ae1-8a39ea5cce48","Type":"ContainerStarted","Data":"6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3"}
Oct 31 07:28:39.568423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.566423    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrmzc" event={"ID":"570337d2-bd49-4f21-9f34-eb0a9111aa27","Type":"ContainerStarted","Data":"334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1"}
Oct 31 07:28:39.568423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.567568    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerStarted","Data":"75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d"}
Oct 31 07:28:39.568863 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.568834    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dpqwq" event={"ID":"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab","Type":"ContainerStarted","Data":"f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966"}
Oct 31 07:28:39.570260 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.570235    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde"}
Oct 31 07:28:39.572614 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.572589    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlw2n" event={"ID":"8cbf450b-951d-4782-9f73-bcbe937a69b7","Type":"ContainerStarted","Data":"9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1"}
Oct 31 07:28:39.574294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.574268    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rhw4q" event={"ID":"36fe2da9-e59f-4b74-b99f-d1158fe8a08a","Type":"ContainerStarted","Data":"478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef"}
Oct 31 07:28:39.750230 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.750185    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:23:39 +0000 UTC" deadline="2028-04-28 00:57:37.162684328 +0000 UTC"
Oct 31 07:28:39.750230 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:39.750228    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13073h28m57.412460781s"
Oct 31 07:28:40.163454 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.163411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:40.163662 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.163489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:40.163662 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.163625    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:40.163789 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.163691    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:42.163671826 +0000 UTC m=+6.128895270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:40.163789 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.163775    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:40.163920 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.163811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:42.163798713 +0000 UTC m=+6.129022153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:40.264776 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.264688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:40.264978 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.264911    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:40.264978 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.264937    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:40.264978 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.264951    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:40.265174 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.265029    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:28:42.264989923 +0000 UTC m=+6.230213362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.554268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.554420    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.554522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.554612    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.554686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:40.554835 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:40.554758    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:40.750937 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.750857    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:23:39 +0000 UTC" deadline="2028-04-05 02:22:09.468046588 +0000 UTC"
Oct 31 07:28:40.750937 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:40.750919    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12522h53m28.717131149s"
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.194896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.195277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.195428    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.195500    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:46.195479471 +0000 UTC m=+10.160702913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.195579    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:42.195675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.195619    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:46.195607184 +0000 UTC m=+10.160830622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:42.296148 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.296109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:42.296386 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.296316    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:42.296386 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.296339    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:42.296386 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.296352    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:42.296687 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.296423    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:28:46.296402149 +0000 UTC m=+10.261625593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:42.551538 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.551303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:42.551538 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.551308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:42.551538 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.551445    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:42.551538 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.551471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:42.551865 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.551575    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:42.551865 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:42.551671    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:42.622392 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.622354    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"9d8d2bd7442930f2267d92c4a39b2cf9","Type":"ContainerStarted","Data":"c33ffe9ae1d67a6bc727087d0be4c8e26fb8299d1f5c6e4b4f91f4732ab749cf"}
Oct 31 07:28:42.636571 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.636537    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c2d27ecaeaabe5b2e48a361bbe98176" containerID="541680c5238aee69c1c1ddc0bb76a12e1dc54727ba3821f9f14df8848b36c994" exitCode=0
Oct 31 07:28:42.636953 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.636830    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerDied","Data":"541680c5238aee69c1c1ddc0bb76a12e1dc54727ba3821f9f14df8848b36c994"}
Oct 31 07:28:42.639948 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.639926    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerStarted","Data":"550ac44d58e2e4c884d2a8e7adf2804d2e4ff5d0094bc93685a137c1e1014279"}
Oct 31 07:28:42.745694 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:42.745587    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" podStartSLOduration=3.745567797 podStartE2EDuration="3.745567797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:42.744837721 +0000 UTC m=+6.710061168" watchObservedRunningTime="2026-10-31 07:28:42.745567797 +0000 UTC m=+6.710791244"
Oct 31 07:28:43.659659 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:43.659593    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerStarted","Data":"172f79cef32b5c21c01f99f1a0b476596a42ba273ba4addadacf0b223b05a184"}
Oct 31 07:28:43.670983 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:43.670934    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="550ac44d58e2e4c884d2a8e7adf2804d2e4ff5d0094bc93685a137c1e1014279" exitCode=0
Oct 31 07:28:43.672017 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:43.671985    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"550ac44d58e2e4c884d2a8e7adf2804d2e4ff5d0094bc93685a137c1e1014279"}
Oct 31 07:28:43.920152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:43.920018    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" podStartSLOduration=4.91999835 podStartE2EDuration="4.91999835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:43.792448189 +0000 UTC m=+7.757671637" watchObservedRunningTime="2026-10-31 07:28:43.91999835 +0000 UTC m=+7.885221798"
Oct 31 07:28:44.552158 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:44.552125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:44.552339 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:44.552284    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:44.552424 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:44.552367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:44.552482 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:44.552439    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:44.552701 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:44.552606    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:44.552784 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:44.552698    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:44.679948 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:44.679910    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rhw4q" event={"ID":"36fe2da9-e59f-4b74-b99f-d1158fe8a08a","Type":"ContainerStarted","Data":"87029384773deb448550896452a01f3b3bb508ee5c36c8c669e4a413cfdac836"}
Oct 31 07:28:45.684636 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:45.684594    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65p5r" event={"ID":"3fc55e14-b1ff-4c2e-96c2-81fd385b3987","Type":"ContainerStarted","Data":"2288cf2979da7a1c71c629f1dc9d62e319b9a518a6ca596ab6065f2cbdae012d"}
Oct 31 07:28:45.688766 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:45.688737    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh" event={"ID":"e08cf711-53da-4c43-8ae1-8a39ea5cce48","Type":"ContainerStarted","Data":"769068ef487b1091bc335b2db2e7c5ab12110e7952ee476ff353f4cd8fd60cab"}
Oct 31 07:28:45.807291 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:45.807185    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rhw4q" podStartSLOduration=4.079404285 podStartE2EDuration="8.80716094s" totalImagesPullingTime="4.727756655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:44.806725058 +0000 UTC m=+8.771948505" watchObservedRunningTime="2026-10-31 07:28:45.80716094 +0000 UTC m=+9.772384388"
Oct 31 07:28:46.052713 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.052636    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:46.053329 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.053306    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:46.179800 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.179644    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-65p5r" podStartSLOduration=3.2170552040000002 podStartE2EDuration="9.179627903s" totalImagesPullingTime="5.962572699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:45.807771757 +0000 UTC m=+9.772995208" watchObservedRunningTime="2026-10-31 07:28:46.179627903 +0000 UTC m=+10.144851374"
Oct 31 07:28:46.229433 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.229388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:46.229606 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.229470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:46.229606 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.229594    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:46.229726 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.229666    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:54.229645286 +0000 UTC m=+18.194868713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:46.229790 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.229737    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:46.229790 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.229773    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:54.229760817 +0000 UTC m=+18.194984242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:46.330135 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.330099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:46.330323 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.330266    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:46.330323 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.330286    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:46.330323 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.330301    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:46.330501 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.330371    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:28:54.330344574 +0000 UTC m=+18.295568000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.568813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.568955    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.569063    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.569192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.569268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:46.570633 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:46.569420    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:46.691754 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.691726    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:46.692436 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:46.692215    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:28:47.570838 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:47.570463    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 07:28:47.696152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:47.696107    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh" event={"ID":"e08cf711-53da-4c43-8ae1-8a39ea5cce48","Type":"ContainerStarted","Data":"6c6b953509a470e8ba3e4444671ccc7e79758edb8930700915a513571b779848"}
Oct 31 07:28:48.510823 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.510710    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:28:47.570482942Z","UUID":"b3e4f316-59c9-4e28-9054-8d86b73816c2","Handler":null,"Name":"","Endpoint":""}
Oct 31 07:28:48.512525 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.512503    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 07:28:48.512627 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.512537    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 07:28:48.551161 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.551124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:48.551305 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:48.551236    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:48.551305 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.551297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:48.551438 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:48.551358    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:48.551747 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.551730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:48.551830 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:48.551812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:48.701320 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.700999    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrmzc" event={"ID":"570337d2-bd49-4f21-9f34-eb0a9111aa27","Type":"ContainerStarted","Data":"e39081afded205fe1369a32aca15b80ec1b31133d090d8cba32f58a55b550910"}
Oct 31 07:28:48.703695 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.703653    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerStarted","Data":"592c641b49d997344b611f6b3afd9eaae421c1dd3a71c5f4ef5b77071fec71d1"}
Oct 31 07:28:48.706764 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.706734    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dpqwq" event={"ID":"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab","Type":"ContainerStarted","Data":"c673012f152dfdd3fdb0cf9f650f4904f8f0b3cd624a731a77f79c8ea8d2c9fd"}
Oct 31 07:28:48.823111 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.822989    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-xrmzc" podStartSLOduration=2.518779522 podStartE2EDuration="11.822971981s" totalImagesPullingTime="9.304192459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:48.822283652 +0000 UTC m=+12.787507098" watchObservedRunningTime="2026-10-31 07:28:48.822971981 +0000 UTC m=+12.788195428"
Oct 31 07:28:48.945269 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:48.945213    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-dpqwq" podStartSLOduration=3.163569004 podStartE2EDuration="11.945200058s" totalImagesPullingTime="8.781631054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:48.945175497 +0000 UTC m=+12.910398945" watchObservedRunningTime="2026-10-31 07:28:48.945200058 +0000 UTC m=+12.910423504"
Oct 31 07:28:49.711582 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:49.711498    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="592c641b49d997344b611f6b3afd9eaae421c1dd3a71c5f4ef5b77071fec71d1" exitCode=0
Oct 31 07:28:49.712082 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:49.711603    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"592c641b49d997344b611f6b3afd9eaae421c1dd3a71c5f4ef5b77071fec71d1"}
Oct 31 07:28:49.713568 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:49.713521    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlw2n" event={"ID":"8cbf450b-951d-4782-9f73-bcbe937a69b7","Type":"ContainerStarted","Data":"cf64422dced328d5c43ab858bb4caff0b10e60b10d19eeb351824f9785e71571"}
Oct 31 07:28:49.997942 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:49.997755    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nlw2n" podStartSLOduration=3.978045598 podStartE2EDuration="12.997739572s" totalImagesPullingTime="9.019693974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:49.997244023 +0000 UTC m=+13.962467467" watchObservedRunningTime="2026-10-31 07:28:49.997739572 +0000 UTC m=+13.962963014"
Oct 31 07:28:50.550999 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.550925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:50.550999 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.550980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:50.551153 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.550929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:50.551153 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:50.551049    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:50.551153 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:50.551129    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:50.551244 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:50.551181    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:50.718659 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.718619    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blhz6" event={"ID":"24d69252-ed4e-41a4-abc0-018958c37b4d","Type":"ContainerStarted","Data":"51944af197799b30d5a5fa41ae235d75cd452fa9e32a5df34001fad21f898c37"}
Oct 31 07:28:50.722596 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.722572    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh" event={"ID":"e08cf711-53da-4c43-8ae1-8a39ea5cce48","Type":"ContainerStarted","Data":"81d4dd8e0712efb8d4bdde8d41e8a19272b1ab8bca90aa2ec852152b5e2f87a2"}
Oct 31 07:28:50.833930 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.832899    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-blhz6" podStartSLOduration=2.520739342 podStartE2EDuration="13.832885933s" totalImagesPullingTime="11.312146591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:50.832654197 +0000 UTC m=+14.797877642" watchObservedRunningTime="2026-10-31 07:28:50.832885933 +0000 UTC m=+14.798109376"
Oct 31 07:28:50.945867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:50.945823    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh" podStartSLOduration=3.41826189 podStartE2EDuration="13.945808051s" totalImagesPullingTime="10.527546161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:50.9458 +0000 UTC m=+14.911023444" watchObservedRunningTime="2026-10-31 07:28:50.945808051 +0000 UTC m=+14.911031493"
Oct 31 07:28:51.726823 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:51.726786    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="941efff3f1d275efde55c9cbd32b32a575b61b7eacb834707562150f3504fe70" exitCode=0
Oct 31 07:28:51.727559 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:51.726889    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"941efff3f1d275efde55c9cbd32b32a575b61b7eacb834707562150f3504fe70"}
Oct 31 07:28:52.551595 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:52.551560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:52.551779 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:52.551625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:52.551779 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:52.551634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:52.551779 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:52.551720    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:52.551944 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:52.551856    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:52.551944 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:52.551932    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:53.733936 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:53.733895    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="0a48dd73d0294af94432748a5d8574ec3e565910353539370afd11d1ec93e011" exitCode=0
Oct 31 07:28:53.734638 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:53.733936    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"0a48dd73d0294af94432748a5d8574ec3e565910353539370afd11d1ec93e011"}
Oct 31 07:28:54.293417 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.293255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:54.293542 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.293438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:54.293542 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.293404    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:54.293542 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.293517    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:54.293542 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.293531    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:29:10.293516258 +0000 UTC m=+34.258739679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:28:54.293692 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.293555    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:29:10.293544316 +0000 UTC m=+34.258767757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:28:54.394771 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.394742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:54.394917 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.394900    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:28:54.394983 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.394921    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:28:54.394983 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.394931    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:54.395058 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.394995    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:29:10.394977988 +0000 UTC m=+34.360201423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:28:54.551629 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.551607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:54.551629 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.551624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:54.551744 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.551685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:54.551785 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.551769    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:54.551859 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.551845    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:54.551909 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:54.551894    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:54.739692 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.739402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:28:54.740157 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740036    2576 generic.go:356] "Generic (PLEG): container finished" podID="958faca4-910f-457f-8f09-ce70c47b6fed" containerID="9288ca99c668d4c4478d35353ceea105d94239424403c7a1c52a9b060b622538" exitCode=1
Oct 31 07:28:54.740157 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740083    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"f2d5bd330021c3d07da00e6ca4500fd4c156eabf25b69dc48aacc81e7faa38c1"}
Oct 31 07:28:54.740229 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740158    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"02f3139690cf1711f052d562b44e701730886efc72b056abb392174d4f91f921"}
Oct 31 07:28:54.740229 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740190    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"67acf8c9a2eb623860a3d8443f88b14cad73a6cab9ca36366ed58602ad4e6e1f"}
Oct 31 07:28:54.740229 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740226    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"00550f00cf04623dbcc510d13d916372e5e4c57f5743981c40f8f4c27bbb3332"}
Oct 31 07:28:54.740338 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740253    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerDied","Data":"9288ca99c668d4c4478d35353ceea105d94239424403c7a1c52a9b060b622538"}
Oct 31 07:28:54.740338 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:54.740295    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"d119d0836f7d4b4bee4855c5417fe8bf0dd210de8d4e67197197e54f996b072b"}
Oct 31 07:28:55.744666 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:55.744575    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="9bd3cbffc3531c5e88627778b56dc4dbd4c406d9573fb6f9bcd1ae314a61ab6b" exitCode=0
Oct 31 07:28:55.744666 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:55.744634    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"9bd3cbffc3531c5e88627778b56dc4dbd4c406d9573fb6f9bcd1ae314a61ab6b"}
Oct 31 07:28:56.551762 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.551732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:56.551914 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:56.551851    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:56.551914 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.551893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:56.551996 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.551932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:56.552033 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:56.552016    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:56.552100 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:56.552083    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:56.750320 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.750284    2576 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="ea57c5d769ca4c362e5b7de5dbf68f80caaf85d62e2d40e1a7bbc83e101833e6" exitCode=0
Oct 31 07:28:56.750814 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.750355    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerDied","Data":"ea57c5d769ca4c362e5b7de5dbf68f80caaf85d62e2d40e1a7bbc83e101833e6"}
Oct 31 07:28:56.753352 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.753284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:28:56.753640 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:56.753621    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"0336ecaf7fee6cb55c81052efada8bf4fd7b7dbb47a2b4df1471d0a7f909016f"}
Oct 31 07:28:57.758719 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:57.758683    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" event={"ID":"61e2f3ab-4e74-4fcf-834f-76c10bb97f20","Type":"ContainerStarted","Data":"67518c19fca77dc92da1467887987d770d0bd12e046974bfcf83bde30071b973"}
Oct 31 07:28:57.876686 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:57.876638    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7rdr6" podStartSLOduration=8.647681128 podStartE2EDuration="20.87662461s" totalImagesPullingTime="12.228943482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:57.876144955 +0000 UTC m=+21.841368429" watchObservedRunningTime="2026-10-31 07:28:57.87662461 +0000 UTC m=+21.841848053"
Oct 31 07:28:58.551644 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:58.551604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:28:58.551644 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:58.551627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:28:58.551888 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:58.551746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:28:58.551888 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:58.551763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:28:58.551888 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:58.551821    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:28:58.551888 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:28:58.551877    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:28:58.765139 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:58.765114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:28:59.771316 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.771285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:28:59.771741 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.771617    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"55860d5ae367a57c6ae5d61ea21c3b5caf9a4e3f4833a5725c6fae603520a89f"}
Oct 31 07:28:59.771903 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.771884    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:59.771980 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.771958    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:28:59.772060 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.772043    2576 scope.go:122] "RemoveContainer" containerID="9288ca99c668d4c4478d35353ceea105d94239424403c7a1c52a9b060b622538"
Oct 31 07:28:59.789390 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:28:59.789248    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:00.550874 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.550848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:00.550874 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.550862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:00.551224 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.550862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:00.551224 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:00.550943    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:00.551224 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:00.551039    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:00.551224 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:00.551123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:00.777556 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.777531    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:29:00.777944 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.777858    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" event={"ID":"958faca4-910f-457f-8f09-ce70c47b6fed","Type":"ContainerStarted","Data":"141b63c4d14b492d2c0b35f61fe26587638dd07617a89e8a98ee38254b20a48d"}
Oct 31 07:29:00.778118 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.778099    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:00.792635 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.792612    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:00.982715 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:00.982662    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb" podStartSLOduration=8.647356532 podStartE2EDuration="23.982649667s" totalImagesPullingTime="15.335293135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:00.949171686 +0000 UTC m=+24.914395128" watchObservedRunningTime="2026-10-31 07:29:00.982649667 +0000 UTC m=+24.947873109"
Oct 31 07:29:01.522055 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.522022    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mlgpz"]
Oct 31 07:29:01.522258 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.522163    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:01.522320 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:01.522264    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:01.524847 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.524820    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6dr5"]
Oct 31 07:29:01.524992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.524948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:01.525079 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:01.525049    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:01.525440 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.525423    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7x5v"]
Oct 31 07:29:01.525514 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:01.525505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:01.525631 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:01.525613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:03.551534 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:03.551505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:03.551936 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:03.551541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:03.551936 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:03.551501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:03.551936 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:03.551631    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:03.551936 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:03.551702    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:03.551936 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:03.551769    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:05.551396 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:05.551358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:05.551396 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:05.551390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:05.551911 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:05.551470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:05.551911 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:05.551478    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:05.551911 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:05.551541    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:05.551911 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:05.551649    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:07.551613 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:07.551425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:07.552077 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:07.551492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:07.552077 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:07.551685    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:07.552077 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:07.551793    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:07.552077 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:07.551500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:07.552077 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:07.551874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:09.551115 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:09.551082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:09.551592 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:09.551082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:09.551592 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:09.551190    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:09.551592 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:09.551082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:09.551592 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:09.551272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:09.551592 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:09.551332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:10.310548 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:10.310511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:10.310713 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.310664    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:29:10.310713 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:10.310677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:10.310781 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.310722    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs podName:6320fb1d-596d-4090-aec7-f4d56306d552 nodeName:}" failed. No retries permitted until 2026-10-31 07:29:42.310706544 +0000 UTC m=+66.275929978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs") pod "network-metrics-daemon-j7x5v" (UID: "6320fb1d-596d-4090-aec7-f4d56306d552") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:29:10.310820 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.310779    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:29:10.310856 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.310823    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret podName:7e23265d-162b-4b43-9b34-2f66f5cbd362 nodeName:}" failed. No retries permitted until 2026-10-31 07:29:42.310810645 +0000 UTC m=+66.276034066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret") pod "global-pull-secret-syncer-mlgpz" (UID: "7e23265d-162b-4b43-9b34-2f66f5cbd362") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:29:10.411092 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:10.411058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:10.411255 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.411193    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:29:10.411255 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.411206    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:29:10.411255 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.411216    2576 projected.go:196] Error preparing data for projected volume kube-api-access-v6cp7 for pod openshift-network-diagnostics/network-check-target-f6dr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:29:10.411355 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:10.411261    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7 podName:ccc7627c-1675-4147-9ba1-bb9e721b112e nodeName:}" failed. No retries permitted until 2026-10-31 07:29:42.411247163 +0000 UTC m=+66.376470583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6cp7" (UniqueName: "kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7") pod "network-check-target-f6dr5" (UID: "ccc7627c-1675-4147-9ba1-bb9e721b112e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:29:11.551413 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:11.551378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:11.551819 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:11.551421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:11.551819 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:11.551469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:11.551819 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:11.551483    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:11.551819 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:11.551546    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:11.551819 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:11.551594    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:11.770701 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:11.770675    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrmzc_570337d2-bd49-4f21-9f34-eb0a9111aa27/dns-node-resolver/0.log"
Oct 31 07:29:12.207803 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:12.207774    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-65p5r_3fc55e14-b1ff-4c2e-96c2-81fd385b3987/node-ca/0.log"
Oct 31 07:29:13.551785 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:13.551761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:13.552184 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:13.551794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:13.552184 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:13.551853    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:13.552184 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:13.551899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:13.552184 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:13.551997    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:13.552184 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:13.552063    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:15.551444 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:15.551405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:15.551833 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:15.551405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:15.551833 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:15.551521    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:15.551833 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:15.551411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:15.551833 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:15.551587    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:15.551833 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:15.551681    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:17.551171 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:17.551134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:17.551569 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:17.551207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:17.551569 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:17.551290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:17.551569 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:17.551296    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:17.551569 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:17.551372    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:17.551569 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:17.551440    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:19.551203 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:19.551167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:19.551203 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:19.551204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:19.551610 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:19.551288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:19.551610 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:19.551315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:19.551610 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:19.551380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:19.551610 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:19.551421    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:21.550893 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:21.550859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:21.550893 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:21.550878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:21.551444 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:21.550870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:21.551444 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:21.551005    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:21.551444 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:21.551063    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:21.551444 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:21.551093    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:23.551194 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:23.551160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:23.551675 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:23.551160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:23.551675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:23.551294    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6dr5" podUID="ccc7627c-1675-4147-9ba1-bb9e721b112e"
Oct 31 07:29:23.551675 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:23.551160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:23.551675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:23.551350    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j7x5v" podUID="6320fb1d-596d-4090-aec7-f4d56306d552"
Oct 31 07:29:23.551675 ip-10-0-140-145 kubenswrapper[2576]: E1031 07:29:23.551405    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mlgpz" podUID="7e23265d-162b-4b43-9b34-2f66f5cbd362"
Oct 31 07:29:23.888042 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:23.888013    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeReady"
Oct 31 07:29:23.891037 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:23.888410    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 07:29:24.054004 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.053950    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tlqmn"]
Oct 31 07:29:24.055918 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.055894    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqws7"]
Oct 31 07:29:24.056044 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.056016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.057376 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.057355    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j5d2p"]
Oct 31 07:29:24.057498 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.057463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.058801 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.058785    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlqmn"]
Oct 31 07:29:24.058917 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.058857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.065593 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.065573    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqws7"]
Oct 31 07:29:24.085464 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.085444    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5d2p"]
Oct 31 07:29:24.105760 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58l9q\" (UniqueName: \"kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.105864 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.105864 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.105935 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghn89\" (UniqueName: \"kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.105986 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.106022 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.105995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.106022 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.106012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf4s8\" (UniqueName: \"kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.106082 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.106029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.106082 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.106049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.106082 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.106066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.106164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.106102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.108522 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.108506    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 07:29:24.108736 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.108722    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 07:29:24.108775 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.108731    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xb4h7\""
Oct 31 07:29:24.109378 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.109363    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 07:29:24.109648 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.109633    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 07:29:24.109705 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.109637    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-m5kd5\""
Oct 31 07:29:24.206925 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.206892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.206925 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.206931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf4s8\" (UniqueName: \"kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.207164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.206957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.207164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.207164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207164 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58l9q\" (UniqueName: \"kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.207404 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.207404 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207404 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207283    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207404 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghn89\" (UniqueName: \"kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207404 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207648 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.207648 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207591    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.207713 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.207647    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.208780 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208760    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 07:29:24.208874 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208767    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 07:29:24.208926 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208878    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 07:29:24.208926 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208894    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g75wk\""
Oct 31 07:29:24.208926 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208898    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 07:29:24.208926 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.208900    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 07:29:24.210914 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.210898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.211099 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.211082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.218129 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.218109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.219510 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.219492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.266821 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.266794    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58l9q\" (UniqueName: \"kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.266948 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.266822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghn89\" (UniqueName: \"kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.266948 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.266830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf4s8\" (UniqueName: \"kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.368264 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.368238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:24.374571 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.374551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:24.381344 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.381322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:24.844686 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.844653    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlqmn"]
Oct 31 07:29:24.848221 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:24.848197    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24defd82_e512_412f_8982_b02931914bb6.slice/crio-a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827 WatchSource:0}: Error finding container a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827: Status 404 returned error can't find the container with id a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827
Oct 31 07:29:24.856535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.856512    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqws7"]
Oct 31 07:29:24.857020 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:24.857000    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5d2p"]
Oct 31 07:29:24.887812 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:24.887787    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45d8fde_7e93_4d15_96ad_1e5fef70da06.slice/crio-39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af WatchSource:0}: Error finding container 39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af: Status 404 returned error can't find the container with id 39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af
Oct 31 07:29:24.889258 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:24.889237    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25347064_7cf0_4556_a6cd_b4bf8dbd5be7.slice/crio-966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0 WatchSource:0}: Error finding container 966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0: Status 404 returned error can't find the container with id 966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0
Oct 31 07:29:25.550899 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.550861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:25.551151 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.550938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:25.551151 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.550986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:25.603794 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.603775    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 07:29:25.603915 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.603885    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 07:29:25.654423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.654394    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-crxcw\""
Oct 31 07:29:25.654548 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.654472    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwql\""
Oct 31 07:29:25.654548 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.654482    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 07:29:25.654623 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.654553    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 07:29:25.654623 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.654570    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5qqnh\""
Oct 31 07:29:25.836724 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.836633    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5d2p" event={"ID":"25347064-7cf0-4556-a6cd-b4bf8dbd5be7","Type":"ContainerStarted","Data":"2c0d1224e06ae9355a98375d7035c8f4c12c64c5529035e37c81ced94758d83a"}
Oct 31 07:29:25.836893 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.836741    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5d2p" event={"ID":"25347064-7cf0-4556-a6cd-b4bf8dbd5be7","Type":"ContainerStarted","Data":"966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0"}
Oct 31 07:29:25.838536 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.838506    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqws7" event={"ID":"d45d8fde-7e93-4d15-96ad-1e5fef70da06","Type":"ContainerStarted","Data":"39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af"}
Oct 31 07:29:25.840228 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:25.840180    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlqmn" event={"ID":"24defd82-e512-412f-8982-b02931914bb6","Type":"ContainerStarted","Data":"a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827"}
Oct 31 07:29:26.845839 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:26.845804    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5d2p" event={"ID":"25347064-7cf0-4556-a6cd-b4bf8dbd5be7","Type":"ContainerStarted","Data":"167801c60c00caf9c21c7197cb42d73dedabd271fc4989a9b27b70fa61fcd820"}
Oct 31 07:29:27.851531 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.851493    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlqmn" event={"ID":"24defd82-e512-412f-8982-b02931914bb6","Type":"ContainerStarted","Data":"be8d7b741121b7f34c1dadb45981eaecde8f6d5e1104710c2d2824b96c101022"}
Oct 31 07:29:27.851998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.851600    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlqmn" event={"ID":"24defd82-e512-412f-8982-b02931914bb6","Type":"ContainerStarted","Data":"465002e557e66c15035f3eee7c678b4a91394a789240ac7dbd2ba15776e7cf69"}
Oct 31 07:29:27.852068 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.852047    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:27.970050 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.969989    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-tlqmn" podStartSLOduration=2.916711859 podStartE2EDuration="4.969951762s" totalImagesPullingTime="2.053239903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:27.969912393 +0000 UTC m=+51.935135838" watchObservedRunningTime="2026-10-31 07:29:27.969951762 +0000 UTC m=+51.935175202"
Oct 31 07:29:27.980557 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.980534    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"]
Oct 31 07:29:27.982228 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:27.982213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:28.035067 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.035042    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g5szt\""
Oct 31 07:29:28.035067 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.035062    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 31 07:29:28.036143 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.036118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sf77f\" (UID: \"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:28.040349 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.040327    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"]
Oct 31 07:29:28.138554 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.138471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sf77f\" (UID: \"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:28.141070 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.141043    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sf77f\" (UID: \"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:28.332095 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.332062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:28.693224 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.693192    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"]
Oct 31 07:29:28.696653 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:28.696628    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82d0ab7_dbcd_4622_b5c8_1c1f543a8bf3.slice/crio-90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1 WatchSource:0}: Error finding container 90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1: Status 404 returned error can't find the container with id 90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1
Oct 31 07:29:28.855786 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.855744    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5d2p" event={"ID":"25347064-7cf0-4556-a6cd-b4bf8dbd5be7","Type":"ContainerStarted","Data":"ffd3bbf167150d21c6ee170dac24fb54493e520f316d5d35f394b5f68378dce1"}
Oct 31 07:29:28.857271 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.857244    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqws7" event={"ID":"d45d8fde-7e93-4d15-96ad-1e5fef70da06","Type":"ContainerStarted","Data":"e4b811faefd129b72d4f5440c11852a695ac5d8ade205778f77a9f7e928a5a1b"}
Oct 31 07:29:28.858346 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.858323    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f" event={"ID":"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3","Type":"ContainerStarted","Data":"90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1"}
Oct 31 07:29:28.971515 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:28.971418    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j5d2p" podStartSLOduration=3.02746156 podStartE2EDuration="5.971402127s" totalImagesPullingTime="2.943940567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:29:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:28.970484756 +0000 UTC m=+52.935708198" watchObservedRunningTime="2026-10-31 07:29:28.971402127 +0000 UTC m=+52.936625571"
Oct 31 07:29:30.865261 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:30.865221    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f" event={"ID":"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3","Type":"ContainerStarted","Data":"9854eba1d4519819c56322075ba14e5d9f7bc92ab9ef64d65321f2683b57338c"}
Oct 31 07:29:30.865764 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:30.865441    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:30.871878 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:30.871855    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:30.978773 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:30.978692    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f" podStartSLOduration=2.616973641 podStartE2EDuration="3.978675104s" totalImagesPullingTime="1.361701463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:30.978076564 +0000 UTC m=+54.943300007" watchObservedRunningTime="2026-10-31 07:29:30.978675104 +0000 UTC m=+54.943898548"
Oct 31 07:29:30.979141 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:30.979112    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqws7" podStartSLOduration=4.884619394 podStartE2EDuration="7.979104577s" totalImagesPullingTime="3.094485183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:29.083579161 +0000 UTC m=+53.048802605" watchObservedRunningTime="2026-10-31 07:29:30.979104577 +0000 UTC m=+54.944328020"
Oct 31 07:29:32.578804 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.578772    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"]
Oct 31 07:29:32.580569 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.580554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.668456 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.668425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.668609 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.668496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.668609 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.668566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffc9h\" (UniqueName: \"kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.668609 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.668597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.683141 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683118    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 07:29:32.683215 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683163    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 07:29:32.683253 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683227    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cznnw\""
Oct 31 07:29:32.683450 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683439    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 07:29:32.683497 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683484    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 07:29:32.683529 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.683487    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 07:29:32.737954 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.736192    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"]
Oct 31 07:29:32.769112 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.769081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.769191 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.769145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.769191 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.769173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffc9h\" (UniqueName: \"kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.769285 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.769198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.769842 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.769815    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.771700 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.771670    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.771700 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.771684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.794274 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.794256    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:32.826327 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.826303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffc9h\" (UniqueName: \"kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:32.891687 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:32.891615    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:33.255327 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.255293    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"]
Oct 31 07:29:33.258276 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:33.258241    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa2361c_1e80_4fec_aca7_57e67cc2c905.slice/crio-ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d WatchSource:0}: Error finding container ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d: Status 404 returned error can't find the container with id ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d
Oct 31 07:29:33.812664 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.812631    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:29:33.814797 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.814782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.867996 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.867937    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wsq7b\""
Oct 31 07:29:33.867996 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.867997    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 31 07:29:33.868209 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.868011    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 31 07:29:33.868209 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.867995    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 31 07:29:33.868209 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.868038    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 31 07:29:33.875633 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.875603    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96" event={"ID":"eaa2361c-1e80-4fec-aca7-57e67cc2c905","Type":"ContainerStarted","Data":"ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d"}
Oct 31 07:29:33.877984 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.877943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878102 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.877997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878102 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.878066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878176 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.878131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878216 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.878168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878259 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.878224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.878294 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.878269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.917944 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.917910    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 31 07:29:33.918090 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.917980    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 31 07:29:33.918090 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.917988    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 31 07:29:33.918928 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.918909    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:29:33.979297 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979439 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979439 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979528 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979528 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979528 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.979674 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.979660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.980056 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.980031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.980167 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.980117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.980167 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.980150    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.980271 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.980219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.981700 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.981685    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:33.981781 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:33.981767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:34.036450 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:34.036419    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:34.125148 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:34.125079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:34.491759 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:34.491725    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:29:34.497633 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:34.497600    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8607ba6_919e_47c5_901f_72b2d969a14d.slice/crio-76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08 WatchSource:0}: Error finding container 76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08: Status 404 returned error can't find the container with id 76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08
Oct 31 07:29:34.879756 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:34.879723    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccc758886-fc48j" event={"ID":"b8607ba6-919e-47c5-901f-72b2d969a14d","Type":"ContainerStarted","Data":"76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08"}
Oct 31 07:29:35.885543 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:35.885497    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96" event={"ID":"eaa2361c-1e80-4fec-aca7-57e67cc2c905","Type":"ContainerStarted","Data":"a24d4fc23482e8d28a6e899f08320935892b16b1345f029595c89addc1c3fe55"}
Oct 31 07:29:35.885962 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:35.885594    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96" event={"ID":"eaa2361c-1e80-4fec-aca7-57e67cc2c905","Type":"ContainerStarted","Data":"b27e2818e27042a30e17c7bf67acf8c8c94bc5fbd678a33e8169b2e574f8716d"}
Oct 31 07:29:36.000567 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:36.000501    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96" podStartSLOduration=2.407186857 podStartE2EDuration="4.000486229s" totalImagesPullingTime="1.593299372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:36.000192337 +0000 UTC m=+59.965415806" watchObservedRunningTime="2026-10-31 07:29:36.000486229 +0000 UTC m=+59.965709672"
Oct 31 07:29:37.860246 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:37.860213    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:37.892002 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:37.891959    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccc758886-fc48j" event={"ID":"b8607ba6-919e-47c5-901f-72b2d969a14d","Type":"ContainerStarted","Data":"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"}
Oct 31 07:29:38.086819 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:38.086761    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5ccc758886-fc48j" podStartSLOduration=2.192823526 podStartE2EDuration="5.08674264s" totalImagesPullingTime="2.893919114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:38.086133783 +0000 UTC m=+62.051357237" watchObservedRunningTime="2026-10-31 07:29:38.08674264 +0000 UTC m=+62.051966085"
Oct 31 07:29:39.082124 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.082088    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"]
Oct 31 07:29:39.084806 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.084790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.119842 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.119817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.119938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.119848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.120004 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.119991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6pcw\" (UniqueName: \"kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.120042 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.120027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.137589 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.137566    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 07:29:39.137589 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.137581    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pqqq4\""
Oct 31 07:29:39.137721 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.137621    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 07:29:39.144109 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.144088    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"]
Oct 31 07:29:39.192078 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.192048    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"]
Oct 31 07:29:39.194863 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.194841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.209081 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.209060    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2v75"]
Oct 31 07:29:39.211842 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.211828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.221107 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6pcw\" (UniqueName: \"kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.221186 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.221186 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qh2\" (UniqueName: \"kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.221325 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.221359 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.221395 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.221424 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.221456 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.221456 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.221513 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.221488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.222106 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.222086    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.223693 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.223668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.223693 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.223684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.250900 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.250878    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 07:29:39.251899 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.251884    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 07:29:39.252101 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.252085    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 07:29:39.252159 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.252142    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nz7mc\""
Oct 31 07:29:39.259725 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.259707    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"]
Oct 31 07:29:39.277856 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.277835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6pcw\" (UniqueName: \"kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.293466 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.293439    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c7ffn\""
Oct 31 07:29:39.293547 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.293470    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 07:29:39.293585 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.293550    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 07:29:39.322033 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.321985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322122 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322122 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322122 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322122 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322251 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcf9m\" (UniqueName: \"kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322292 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322423 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322416    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322508 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322581 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322622 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322664 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qh2\" (UniqueName: \"kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322664 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.322773 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322831 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.322953 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.322926    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.323130 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.323113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.324630 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.324609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.324996 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.324960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.350880 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.350830    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 07:29:39.379371 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.379349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qh2\" (UniqueName: \"kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.398175 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.398156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:39.423688 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.423830 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.423830 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcf9m\" (UniqueName: \"kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.423830 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.423830 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.423830 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423884    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.423990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.424016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.424043    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424104 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.424067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424438 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.424288    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.424490 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.424452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.425985 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.425947    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.426356 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.426338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.479938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.479907    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcf9m\" (UniqueName: \"kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.509934 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.509908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:39.525930 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.525909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:39.536474 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:39.536442    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49854e3c_2db5_4729_9c2f_aca619b2adaa.slice/crio-d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877 WatchSource:0}: Error finding container d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877: Status 404 returned error can't find the container with id d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877
Oct 31 07:29:39.764546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.764510    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"]
Oct 31 07:29:39.767949 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:39.767918    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae92750_8a5b_4d75_95a7_371bbfc83749.slice/crio-47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a WatchSource:0}: Error finding container 47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a: Status 404 returned error can't find the container with id 47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a
Oct 31 07:29:39.884078 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.884048    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"]
Oct 31 07:29:39.887532 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:39.887501    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af2e3d9_141c_487f_af2e_b1505e4ae1bc.slice/crio-b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9 WatchSource:0}: Error finding container b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9: Status 404 returned error can't find the container with id b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9
Oct 31 07:29:39.900249 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.900219    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w" event={"ID":"eae92750-8a5b-4d75-95a7-371bbfc83749","Type":"ContainerStarted","Data":"b294a406cb2f8160fb7ca03c6d17d8a0d9cf61d95dbf58903b108b75a55a3700"}
Oct 31 07:29:39.900371 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.900277    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w" event={"ID":"eae92750-8a5b-4d75-95a7-371bbfc83749","Type":"ContainerStarted","Data":"99702fb9a9f1cb71c9127b5d00f3f60c52590fd139ec9f0b251fb218266651da"}
Oct 31 07:29:39.900371 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.900302    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w" event={"ID":"eae92750-8a5b-4d75-95a7-371bbfc83749","Type":"ContainerStarted","Data":"47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a"}
Oct 31 07:29:39.901376 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.901352    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2v75" event={"ID":"49854e3c-2db5-4729-9c2f-aca619b2adaa","Type":"ContainerStarted","Data":"d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877"}
Oct 31 07:29:39.902587 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:39.902568    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk" event={"ID":"2af2e3d9-141c-487f-af2e-b1505e4ae1bc","Type":"ContainerStarted","Data":"b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9"}
Oct 31 07:29:41.381711 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.381685    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:29:41.386688 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.386663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441323    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441349    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441389    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441425    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441440    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441441    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441452    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441467    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cs9d6\""
Oct 31 07:29:41.441535 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.441501    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 07:29:41.445570 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445698 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445698 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445698 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445698 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445849 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445882 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445882 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.445938 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.446026 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.445948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.446026 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.446003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.446026 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.446019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.541351 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.541317    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 07:29:41.545770 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.545707    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:29:41.547242 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547368 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547368 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547368 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547526 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547575 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547575 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547680 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547680 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547767 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547767 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547859 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.547859 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.547824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.549014 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.548273    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.549014 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.548668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.549014 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.548961    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.550655 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.550627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.550777 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.550699    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.551348 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.551327    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.551555 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.551533    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.551627 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.551596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.551732 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.551710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.551805 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.551731    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.552158 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.552139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.552517 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.552499    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.606615 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.606589    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.724981 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.724942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:41.913762 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.913734    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w" event={"ID":"eae92750-8a5b-4d75-95a7-371bbfc83749","Type":"ContainerStarted","Data":"8db6e4b141018126e05634967f3c5a80a6b40f1bc94d9de878d56b26c5ba1477"}
Oct 31 07:29:41.915721 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.915690    2576 generic.go:356] "Generic (PLEG): container finished" podID="49854e3c-2db5-4729-9c2f-aca619b2adaa" containerID="8d4229e03ad911309592657c947b30da1aeb341ff785571d3009359335a27bf6" exitCode=0
Oct 31 07:29:41.915829 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.915720    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2v75" event={"ID":"49854e3c-2db5-4729-9c2f-aca619b2adaa","Type":"ContainerDied","Data":"8d4229e03ad911309592657c947b30da1aeb341ff785571d3009359335a27bf6"}
Oct 31 07:29:41.917805 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.917775    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk" event={"ID":"2af2e3d9-141c-487f-af2e-b1505e4ae1bc","Type":"ContainerStarted","Data":"f506a31b02845624e6f94ce7e822703311723aa5436bb57e2f57ffe99665e19d"}
Oct 31 07:29:41.917897 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.917831    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk" event={"ID":"2af2e3d9-141c-487f-af2e-b1505e4ae1bc","Type":"ContainerStarted","Data":"8a9ec6fadd6aa4b3334e108042ba4cce4f7872ac822dc41445610d9e6c8159dd"}
Oct 31 07:29:41.917897 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:41.917863    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk" event={"ID":"2af2e3d9-141c-487f-af2e-b1505e4ae1bc","Type":"ContainerStarted","Data":"6cb91caf377ae699368b1d4bde9b6b58330dd43e0450e699f8a19c705adcbe17"}
Oct 31 07:29:42.032355 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.032313    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w" podStartSLOduration=1.557387092 podStartE2EDuration="3.03229928s" totalImagesPullingTime="1.474912188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:42.031303183 +0000 UTC m=+65.996526626" watchObservedRunningTime="2026-10-31 07:29:42.03229928 +0000 UTC m=+65.997522723"
Oct 31 07:29:42.149067 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.148912    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk" podStartSLOduration=1.465163402 podStartE2EDuration="3.148893012s" totalImagesPullingTime="1.68372961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:42.148075956 +0000 UTC m=+66.113299399" watchObservedRunningTime="2026-10-31 07:29:42.148893012 +0000 UTC m=+66.114116458"
Oct 31 07:29:42.204299 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.204277    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:29:42.208985 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:42.208941    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322020da_5e53_456f_89cb_96195b99f662.slice/crio-187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363 WatchSource:0}: Error finding container 187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363: Status 404 returned error can't find the container with id 187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363
Oct 31 07:29:42.354239 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.354206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:42.354393 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.354256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:42.406643 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.406613    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 07:29:42.407075 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.407060    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 07:29:42.417487 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.417467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:42.417595 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.417497    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:42.455177 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.455112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:42.506843 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.506810    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 07:29:42.567129 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.567103    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 07:29:42.578481 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.578459    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:42.715663 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.715582    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-crxcw\""
Oct 31 07:29:42.722796 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.722773    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwql\""
Oct 31 07:29:42.724858 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.724833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:42.725664 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.725647    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5qqnh\""
Oct 31 07:29:42.731751 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.731737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:42.734950 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.734926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:42.924080 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.924045    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2v75" event={"ID":"49854e3c-2db5-4729-9c2f-aca619b2adaa","Type":"ContainerStarted","Data":"db23cebc57e089eb6bc3c03684cde09cdc38fec30f79c29c2601a424d05c1c57"}
Oct 31 07:29:42.924254 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.924095    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2v75" event={"ID":"49854e3c-2db5-4729-9c2f-aca619b2adaa","Type":"ContainerStarted","Data":"9508c12e1cf0944b1cef402eb62eb587f3c620e8daf9381e0c62d57f15390ab0"}
Oct 31 07:29:42.925306 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:42.925277    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363"}
Oct 31 07:29:43.043854 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.043752    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2v75" podStartSLOduration=2.620251707 podStartE2EDuration="4.043736807s" totalImagesPullingTime="1.337973505s" totalInitContainerRuntime="85.511595ms" isStatefulPod=true podCreationTimestamp="2026-10-31 07:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:43.04280162 +0000 UTC m=+67.008025059" watchObservedRunningTime="2026-10-31 07:29:43.043736807 +0000 UTC m=+67.008960249"
Oct 31 07:29:43.100594 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.099262    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6dr5"]
Oct 31 07:29:43.142573 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:43.142541    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc7627c_1675_4147_9ba1_bb9e721b112e.slice/crio-4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c WatchSource:0}: Error finding container 4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c: Status 404 returned error can't find the container with id 4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c
Oct 31 07:29:43.154992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.153906    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mlgpz"]
Oct 31 07:29:43.154992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.154828    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j7x5v"]
Oct 31 07:29:43.158336 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:43.158308    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e23265d_162b_4b43_9b34_2f66f5cbd362.slice/crio-ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e WatchSource:0}: Error finding container ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e: Status 404 returned error can't find the container with id ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e
Oct 31 07:29:43.158803 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:43.158780    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6320fb1d_596d_4090_aec7_f4d56306d552.slice/crio-c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe WatchSource:0}: Error finding container c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe: Status 404 returned error can't find the container with id c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe
Oct 31 07:29:43.824346 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.824316    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"]
Oct 31 07:29:43.827432 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.827417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:43.867238 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.867209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:43.867347 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.867283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4257\" (UniqueName: \"kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:43.879780 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.879711    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jt2g5\""
Oct 31 07:29:43.879885 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.879870    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 07:29:43.884713 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.884689    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"]
Oct 31 07:29:43.929867 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.929832    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mlgpz" event={"ID":"7e23265d-162b-4b43-9b34-2f66f5cbd362","Type":"ContainerStarted","Data":"ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e"}
Oct 31 07:29:43.931101 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.931074    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7x5v" event={"ID":"6320fb1d-596d-4090-aec7-f4d56306d552","Type":"ContainerStarted","Data":"c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe"}
Oct 31 07:29:43.932462 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.932440    2576 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf" exitCode=0
Oct 31 07:29:43.932573 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.932517    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"}
Oct 31 07:29:43.933607 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.933587    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6dr5" event={"ID":"ccc7627c-1675-4147-9ba1-bb9e721b112e","Type":"ContainerStarted","Data":"4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c"}
Oct 31 07:29:43.968135 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.968109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4257\" (UniqueName: \"kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:43.968481 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.968353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:43.971047 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:43.971021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:44.026054 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.026021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4257\" (UniqueName: \"kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:44.076120 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.075100    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-667fc5fff6-zmrzv"]
Oct 31 07:29:44.078355 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.078332    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.126180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.125464    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:44.126180 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.125539    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:44.131589 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131525    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 07:29:44.131714 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131609    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:44.131714 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131618    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 31 07:29:44.131803 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131793    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 31 07:29:44.131878 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131846    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 31 07:29:44.132032 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131921    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2gp55\""
Oct 31 07:29:44.132032 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.131994    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-146lfq86k66ve\""
Oct 31 07:29:44.137895 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.137866    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667fc5fff6-zmrzv"]
Oct 31 07:29:44.138032 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.138015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.170355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.170502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.170608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.170645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.170696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171174 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.171141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6tzl\" (UniqueName: \"kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.171500 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.171311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6tzl\" (UniqueName: \"kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.272961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.273016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.274152 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.273427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.275618 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.275587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.276307 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.276279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.276578 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.276553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.277018 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.276998    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.278082 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.278057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.332556 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.332523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6tzl\" (UniqueName: \"kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.395017 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.394919    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:44.522354 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.522322    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"]
Oct 31 07:29:44.526130 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:44.526095    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fed36f_e2d8_405b_8ce2_d66a797f1472.slice/crio-20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc WatchSource:0}: Error finding container 20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc: Status 404 returned error can't find the container with id 20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc
Oct 31 07:29:44.777613 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:44.777583    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ede69ed_3423_4f3c_b38a_d14f2fe14d0c.slice/crio-f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0 WatchSource:0}: Error finding container f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0: Status 404 returned error can't find the container with id f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0
Oct 31 07:29:44.778418 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.778396    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667fc5fff6-zmrzv"]
Oct 31 07:29:44.901613 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.901584    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"]
Oct 31 07:29:44.908001 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.906502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.946639 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.946589    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7x5v" event={"ID":"6320fb1d-596d-4090-aec7-f4d56306d552","Type":"ContainerStarted","Data":"0070d6b215d7a5140ddca4fd52159931455197a3521e61355b7c8d4d3804122b"}
Oct 31 07:29:44.951488 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.951454    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv" event={"ID":"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c","Type":"ContainerStarted","Data":"f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0"}
Oct 31 07:29:44.954410 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.954338    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv" event={"ID":"60fed36f-e2d8-405b-8ce2-d66a797f1472","Type":"ContainerStarted","Data":"20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc"}
Oct 31 07:29:44.959053 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.959035    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:44.962813 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.962791    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 31 07:29:44.963046 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.963025    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 31 07:29:44.963122 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.963030    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 31 07:29:44.963443 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.963428    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 31 07:29:44.963499 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.963486    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 31 07:29:44.963499 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.963495    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ss6lb\""
Oct 31 07:29:44.980603 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980757 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980757 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980757 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm94h\" (UniqueName: \"kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:44.980992 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:44.980866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.011740 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.011638    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 31 07:29:45.017107 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.016338    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"]
Oct 31 07:29:45.082207 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm94h\" (UniqueName: \"kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.082574 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.082410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.086993 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.085188    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.086993 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.086405    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.086993 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.086508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.086993 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.086878    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.087809 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.087573    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.087809 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.087756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.088472 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.088426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.143666 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.143603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm94h\" (UniqueName: \"kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.233302 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.233079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:45.676140 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.676051    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"]
Oct 31 07:29:45.682248 ip-10-0-140-145 kubenswrapper[2576]: W1031 07:29:45.682217    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726ecee9_61d2_4025_b198_7ff457b6cbbb.slice/crio-7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83 WatchSource:0}: Error finding container 7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83: Status 404 returned error can't find the container with id 7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83
Oct 31 07:29:45.777224 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.775894    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:29:45.779428 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.779400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.837698 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.837629    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 31 07:29:45.838896 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.838799    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:29:45.890360 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890546 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890794 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.890794 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.890598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.962612 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.961661    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j7x5v" event={"ID":"6320fb1d-596d-4090-aec7-f4d56306d552","Type":"ContainerStarted","Data":"0c3e2423c86f6d72f2aee6ffe855d7966dbe2961b1f6d528b7f86e8269977fae"}
Oct 31 07:29:45.964999 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.964913    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf" event={"ID":"726ecee9-61d2-4025-b198-7ff457b6cbbb","Type":"ContainerStarted","Data":"7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83"}
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.991998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.992998 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.992838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.995358 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.993512    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.995358 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.993922    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.995358 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.994901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.995358 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.995319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:45.998623 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:45.998581    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:46.003413 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.003387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:46.061028 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.060959    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:46.077028 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.076951    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j7x5v" podStartSLOduration=67.48536986 podStartE2EDuration="1m9.076929395s" totalImagesPullingTime="1.591559535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:46.075204285 +0000 UTC m=+70.040427730" watchObservedRunningTime="2026-10-31 07:29:46.076929395 +0000 UTC m=+70.042152839"
Oct 31 07:29:46.096956 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.096922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:46.505697 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.505668    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:29:46.973888 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.973854    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"}
Oct 31 07:29:46.974270 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.973942    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"}
Oct 31 07:29:46.974270 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.973998    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"}
Oct 31 07:29:46.974270 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.974041    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"}
Oct 31 07:29:46.975918 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.975891    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bb4fc5d-sd6w7" event={"ID":"812513cb-4f84-4af1-9f3e-9fa5c9fc673c","Type":"ContainerStarted","Data":"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"}
Oct 31 07:29:46.976047 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:46.975934    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bb4fc5d-sd6w7" event={"ID":"812513cb-4f84-4af1-9f3e-9fa5c9fc673c","Type":"ContainerStarted","Data":"d3e74957c73f6878e37de731fbf6eaaedd5a69fe721e5b1a7e6e1f16e20126bd"}
Oct 31 07:29:47.983378 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:47.983336    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv" event={"ID":"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c","Type":"ContainerStarted","Data":"a104e7932d4476071181c80761d0b4d2b74ad1b346b500d2260c8d9fd403368c"}
Oct 31 07:29:47.987105 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:47.987076    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv" event={"ID":"60fed36f-e2d8-405b-8ce2-d66a797f1472","Type":"ContainerStarted","Data":"bca2f61de46003f38ae1c54cbc60e48d32ba58a499da9fa1ae9a725b1cd1fc41"}
Oct 31 07:29:47.987263 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:47.987130    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:48.004808 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:48.004778    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:48.005860 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:48.005829    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"}
Oct 31 07:29:48.099409 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:48.099350    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-668bb4fc5d-sd6w7" podStartSLOduration=3.099329984 podStartE2EDuration="3.099329984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:47.094017982 +0000 UTC m=+71.059241425" watchObservedRunningTime="2026-10-31 07:29:48.099329984 +0000 UTC m=+72.064553430"
Oct 31 07:29:48.101092 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:48.101045    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv" podStartSLOduration=1.306343914 podStartE2EDuration="4.101029598s" totalImagesPullingTime="2.794685684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:48.098160245 +0000 UTC m=+72.063383693" watchObservedRunningTime="2026-10-31 07:29:48.101029598 +0000 UTC m=+72.066253042"
Oct 31 07:29:48.216000 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:48.212661    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv" podStartSLOduration=2.592935271 podStartE2EDuration="5.212642219s" totalImagesPullingTime="2.619706948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:48.210855521 +0000 UTC m=+72.176078983" watchObservedRunningTime="2026-10-31 07:29:48.212642219 +0000 UTC m=+72.177865663"
Oct 31 07:29:49.014337 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.014298    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerStarted","Data":"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"}
Oct 31 07:29:49.016044 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.016013    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6dr5" event={"ID":"ccc7627c-1675-4147-9ba1-bb9e721b112e","Type":"ContainerStarted","Data":"4675c0d17f16e0100b443f357124d5899b10a0a87c90d4103ec38a376e6e772d"}
Oct 31 07:29:49.016147 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.016091    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:49.018638 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.018613    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf" event={"ID":"726ecee9-61d2-4025-b198-7ff457b6cbbb","Type":"ContainerStarted","Data":"548030e601913bdf64b3198c7d3f48067fb6bfd10370911f7f694477ecc68343"}
Oct 31 07:29:49.018745 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.018668    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf" event={"ID":"726ecee9-61d2-4025-b198-7ff457b6cbbb","Type":"ContainerStarted","Data":"4ca931263eed4d6d059a93defcc6797ca2eef920da00cc53172f8ccc9f014efe"}
Oct 31 07:29:49.018745 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.018698    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf" event={"ID":"726ecee9-61d2-4025-b198-7ff457b6cbbb","Type":"ContainerStarted","Data":"6393622b66a6f213e934acdd0dc33288c937e134af60fa20e0b0aca6496e070f"}
Oct 31 07:29:49.152823 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.152765    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.722233906 podStartE2EDuration="8.152749321s" totalImagesPullingTime="5.417386276s" totalInitContainerRuntime="13.129139ms" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:49.151168849 +0000 UTC m=+73.116392290" watchObservedRunningTime="2026-10-31 07:29:49.152749321 +0000 UTC m=+73.117972777"
Oct 31 07:29:49.277260 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.277149    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf" podStartSLOduration=2.357767877 podStartE2EDuration="5.277130837s" totalImagesPullingTime="2.91936296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:49.275196996 +0000 UTC m=+73.240420439" watchObservedRunningTime="2026-10-31 07:29:49.277130837 +0000 UTC m=+73.242354280"
Oct 31 07:29:49.393791 ip-10-0-140-145 kubenswrapper[2576]: I1031 07:29:49.393637    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f6dr5" podStartSLOduration=67.14958384 podStartE2EDuration="1m12.393621868s" totalImagesPullingTime="5.244038028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:49.391247927 +0000 UTC m=+73.356471369" watchObservedRunningTime="2026-10-31 07:29:49.393621868 +0000 UTC m=+73.358845310"
Oct 31 07:29:50.333476 ip-10-0-140-145 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 07:29:50.345406 ip-10-0-140-145 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 07:29:50.345578 ip-10-0-140-145 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 07:29:50.345627 ip-10-0-140-145 systemd[1]: kubelet.service: Consumed 4.348s CPU time.
Oct 31 07:29:50.356694 ip-10-0-140-145 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 07:29:50.417492 ip-10-0-140-145 kubenswrapper[5872]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:29:50.417492 ip-10-0-140-145 kubenswrapper[5872]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 07:29:50.417492 ip-10-0-140-145 kubenswrapper[5872]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:29:50.417492 ip-10-0-140-145 kubenswrapper[5872]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:29:50.419533 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419447    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.419533 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419532    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.419533 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419537    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419540    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419543    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419546    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419549    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419552    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419554    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419557    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419559    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419562    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419565    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419568    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419570    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419573    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419576    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419579    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419581    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419584    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419587    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.419624 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419597    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419600    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419603    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419606    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419609    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419611    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419614    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419616    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419619    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419622    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419625    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419628    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419631    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419634    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419636    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419639    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419642    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419645    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419655    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.420101 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419658    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419661    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419664    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419667    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419670    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419672    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419675    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419677    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419700    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419705    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419708    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419711    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419714    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419717    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419720    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419724    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419727    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419730    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419733    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419735    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.420544 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419738    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419741    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419744    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419747    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419750    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419753    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419755    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419760    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419764    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419767    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419770    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419773    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419775    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419778    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419780    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419783    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419786    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419788    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419791    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.421019 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419793    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419796    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419798    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419801    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419804    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419806    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419809    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419812    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419815    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419817    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419820    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419823    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419825    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419828    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419831    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419834    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419837    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419840    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419843    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419848    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.421480 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419852    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419856    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419860    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419863    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419866    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419869    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.419871    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420644    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420650    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420653    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420656    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420659    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420662    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420665    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420668    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420671    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420673    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420676    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420679    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.421950 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420681    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420685    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420688    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420690    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420693    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420696    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420699    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420701    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420708    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420710    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420713    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420716    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420719    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420722    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420725    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420727    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420730    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420733    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420735    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420738    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.422409 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420741    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420744    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420746    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420749    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420752    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420754    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420757    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420760    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420763    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420765    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420768    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420771    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420774    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420777    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420780    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420782    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420785    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420788    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420790    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.422901 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420793    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420797    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420800    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420803    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420805    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420808    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420811    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420814    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420817    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420820    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420822    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420825    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420827    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420830    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420832    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420835    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420838    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420840    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420845    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.423369 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420850    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420854    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420856    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420859    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420862    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420864    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420867    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420871    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420874    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420876    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420879    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420882    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420884    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420887    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420891    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420893    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420896    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420899    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420902    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420905    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.423904 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420908    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420911    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420914    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420917    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420919    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420922    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420925    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420927    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420930    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420933    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420935    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420938    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420943    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420947    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420950    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.420952    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421468    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421474    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421478    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.424392 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421484    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421487    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421490    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421493    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421496    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421499    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421501    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421504    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421507    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421510    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421513    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421515    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421518    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421521    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421525    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421529    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421533    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421535    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421538    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421541    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.424836 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421544    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421547    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421550    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421552    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421555    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421558    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421560    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421563    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421566    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421569    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421571    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421574    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421578    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421581    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421584    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421587    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421589    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421592    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421595    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421597    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.425332 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421600    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421603    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421605    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421608    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421610    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421613    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421616    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421619    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421621    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421624    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421626    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421629    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421632    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421635    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421637    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421640    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421643    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421645    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421648    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.425850 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421651    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421653    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421656    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421658    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421661    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421664    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421667    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421670    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421672    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421675    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421678    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421680    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421683    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421686    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421689    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421693    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421696    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421699    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421702    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.426615 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421704    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421707    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421710    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421713    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421716    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421718    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421721    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421724    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421726    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421729    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421731    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421734    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421736    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421739    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421743    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421746    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421749    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421751    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421754    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.427110 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421766    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421768    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421771    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421774    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421777    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.421779    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421880    5872 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421911    5872 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421919    5872 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421928    5872 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421932    5872 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421936    5872 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421940    5872 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421944    5872 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421948    5872 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421951    5872 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421955    5872 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421959    5872 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421974    5872 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421978    5872 flags.go:64] FLAG: --cgroup-root=""
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421981    5872 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421984    5872 flags.go:64] FLAG: --client-ca-file=""
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421987    5872 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 07:29:50.427553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421990    5872 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421995    5872 flags.go:64] FLAG: --cluster-domain=""
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.421998    5872 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422001    5872 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422007    5872 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422011    5872 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422015    5872 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422018    5872 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422021    5872 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422025    5872 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422028    5872 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422031    5872 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422034    5872 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422037    5872 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422041    5872 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422045    5872 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422049    5872 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422052    5872 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422055    5872 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422059    5872 flags.go:64] FLAG: --enable-server="true"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422062    5872 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422067    5872 flags.go:64] FLAG: --event-burst="100"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422070    5872 flags.go:64] FLAG: --event-qps="50"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422073    5872 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 07:29:50.428118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422076    5872 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422080    5872 flags.go:64] FLAG: --eviction-hard=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422085    5872 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422091    5872 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422094    5872 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422098    5872 flags.go:64] FLAG: --eviction-soft=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422101    5872 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422104    5872 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422107    5872 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422110    5872 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422113    5872 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422117    5872 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422121    5872 flags.go:64] FLAG: --feature-gates=""
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422125    5872 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422129    5872 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422132    5872 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422135    5872 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422139    5872 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422142    5872 flags.go:64] FLAG: --help="false"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422145    5872 flags.go:64] FLAG: --hostname-override="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422149    5872 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422152    5872 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422155    5872 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 07:29:50.428688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422159    5872 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422162    5872 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422165    5872 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422169    5872 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422172    5872 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422175    5872 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422178    5872 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422181    5872 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422184    5872 flags.go:64] FLAG: --kube-reserved=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422187    5872 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422190    5872 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422194    5872 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422199    5872 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422203    5872 flags.go:64] FLAG: --lock-file=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422206    5872 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422209    5872 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422212    5872 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422217    5872 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422220    5872 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422223    5872 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422226    5872 flags.go:64] FLAG: --logging-format="text"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422230    5872 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422234    5872 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422237    5872 flags.go:64] FLAG: --manifest-url=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422240    5872 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 07:29:50.429262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422245    5872 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422248    5872 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422252    5872 flags.go:64] FLAG: --max-pods="110"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422255    5872 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422258    5872 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422261    5872 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422264    5872 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422268    5872 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422270    5872 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422273    5872 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422281    5872 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422284    5872 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422287    5872 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422290    5872 flags.go:64] FLAG: --pod-cidr=""
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422293    5872 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422296    5872 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422299    5872 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422302    5872 flags.go:64] FLAG: --port="10250"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422306    5872 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422310    5872 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0e3138f70ce03c146"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422314    5872 flags.go:64] FLAG: --qos-reserved=""
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422318    5872 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422321    5872 flags.go:64] FLAG: --register-node="true"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422324    5872 flags.go:64] FLAG: --register-with-taints=""
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422328    5872 flags.go:64] FLAG: --registry-burst="10"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422331    5872 flags.go:64] FLAG: --registry-qps="5"
Oct 31 07:29:50.429840 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422334    5872 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422337    5872 flags.go:64] FLAG: --reserved-memory=""
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422343    5872 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422346    5872 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422349    5872 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422352    5872 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422356    5872 flags.go:64] FLAG: --runonce="false"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422359    5872 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422362    5872 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422365    5872 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422368    5872 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422371    5872 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422375    5872 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422378    5872 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422381    5872 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422384    5872 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422387    5872 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422390    5872 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422393    5872 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422396    5872 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422399    5872 flags.go:64] FLAG: --system-cgroups=""
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422402    5872 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422408    5872 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422411    5872 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422414    5872 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 07:29:50.430455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422420    5872 flags.go:64] FLAG: --tls-min-version=""
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422423    5872 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422427    5872 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422430    5872 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422433    5872 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422436    5872 flags.go:64] FLAG: --v="2"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422440    5872 flags.go:64] FLAG: --version="false"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422444    5872 flags.go:64] FLAG: --vmodule=""
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422448    5872 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422453    5872 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422598    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422603    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422606    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422609    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422612    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422614    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422617    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422620    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422623    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422626    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422628    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422631    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.431058 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422634    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422636    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422639    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422642    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422645    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422647    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422650    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422652    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422655    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422658    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422662    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422665    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422667    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422671    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422674    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422677    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422679    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422682    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422686    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.431567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422691    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422695    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422698    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422702    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422704    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422707    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422710    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422713    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422716    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422718    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422721    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422723    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422726    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422729    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422732    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422734    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422737    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422740    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422742    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.432038 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422745    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422747    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422750    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422753    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422758    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422761    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422764    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422767    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422770    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422772    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422775    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422778    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422781    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422784    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422787    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422790    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422793    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422795    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422798    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.432684 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422801    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422803    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422806    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422809    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422811    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422814    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422817    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422820    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422822    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422825    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422827    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422830    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422832    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422835    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422838    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422840    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422843    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422847    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422850    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422852    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.433352 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422855    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422858    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422861    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422864    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422866    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422869    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422873    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422875    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422878    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422881    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422884    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422886    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422889    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422892    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422894    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422897    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.434028 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422900    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.422926    5872 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422961    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422977    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422980    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422984    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422987    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422991    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422994    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422996    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.422999    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423002    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423004    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423008    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423011    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423014    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.434732 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423017    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423020    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423022    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423026    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423028    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423031    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423034    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423038    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423042    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423045    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423049    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423052    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423055    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423058    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423061    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423064    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423066    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423069    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423072    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.435444 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423074    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423077    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423081    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423084    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423086    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423089    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423091    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423094    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423097    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423100    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423105    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423107    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423110    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423113    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423115    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423118    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423121    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423124    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423127    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.436078 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423129    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423134    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423137    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423140    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423142    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423145    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423148    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423150    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423153    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423156    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423158    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423161    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423164    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423166    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423169    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423172    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423175    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423177    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423180    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423183    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.436631 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423186    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423189    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423191    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423195    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423198    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423200    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423203    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423206    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423208    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423211    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423214    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423217    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423220    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423224    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423227    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423230    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423232    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423235    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423238    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423241    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.437198 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423243    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423246    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423249    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423251    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423254    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423256    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423259    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423262    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423265    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423268    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423270    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423273    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423278    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.423282    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428097    5872 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428114    5872 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428134    5872 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428139    5872 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428198    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.437664 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428202    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428206    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428209    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428212    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428215    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428218    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428220    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428223    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428226    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428229    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428232    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428235    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428238    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428241    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428244    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428246    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428250    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428253    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428256    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428259    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.438203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428261    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428264    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428267    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428270    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428273    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428275    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428278    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428281    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428284    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428287    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428290    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428293    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428295    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428298    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428300    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428303    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428306    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428308    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428311    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428314    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.438662 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428316    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428319    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428321    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428324    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428327    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428335    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428338    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428341    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428343    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428346    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428349    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428352    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428356    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428360    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428364    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428367    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428369    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428372    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428374    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.439150 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428377    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428380    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428383    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428385    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428388    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428391    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428393    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428396    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428398    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428401    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428404    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428406    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428409    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428411    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428414    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428416    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428419    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428422    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428425    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428432    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.439596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428435    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428438    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428441    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428444    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428446    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428449    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428451    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428454    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428457    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428459    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428462    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428465    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428467    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428471    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428474    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428477    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428480    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428482    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428485    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.440089 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428488    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428490    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428493    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428496    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428498    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428501    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428504    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428531    5872 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428663    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428667    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428670    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428673    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428675    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428679    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428682    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.440534 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428685    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428688    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428691    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428694    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428696    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428699    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428702    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428705    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428707    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428710    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428713    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428715    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428718    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428721    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428723    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428726    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428730    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428733    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428736    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.440892 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428739    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428742    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428744    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428747    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428749    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428752    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428755    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428757    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428760    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428762    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428765    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428768    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428771    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428774    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428777    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428780    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428782    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428785    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428787    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428790    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.441591 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428792    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428795    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428798    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428802    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428804    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428807    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428810    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428812    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428815    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428817    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428820    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428823    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428825    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428828    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428830    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428833    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428835    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428838    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428841    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.442483 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428843    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428846    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428849    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428851    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428854    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428856    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428859    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428862    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428864    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428867    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428870    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428872    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428875    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428877    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428880    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428883    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428885    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428888    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428890    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428893    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.443347 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428895    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428898    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428901    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428903    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428906    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428909    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428911    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428914    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428916    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428919    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428921    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428924    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428926    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428929    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428931    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428934    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428937    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428940    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428942    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428946    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.444070 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.428948    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.428988    5872 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429021    5872 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429026    5872 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429029    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429032    5872 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429035    5872 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429037    5872 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429040    5872 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429045    5872 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429048    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429052    5872 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429056    5872 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429059    5872 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429062    5872 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:29:50.444553 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429065    5872 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429067    5872 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429070    5872 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429073    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429076    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429078    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429081    5872 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429084    5872 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429086    5872 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429089    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429091    5872 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429094    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429097    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429100    5872 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429103    5872 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429106    5872 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429108    5872 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429112    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429114    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429117    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:29:50.444932 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429120    5872 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429122    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429125    5872 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429128    5872 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429130    5872 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429133    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429137    5872 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429140    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429142    5872 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429145    5872 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429148    5872 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429151    5872 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429153    5872 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429156    5872 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429159    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429161    5872 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429164    5872 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429167    5872 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429169    5872 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:29:50.445462 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429172    5872 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429174    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429177    5872 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429180    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429183    5872 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429185    5872 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429188    5872 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429190    5872 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429193    5872 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429196    5872 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429199    5872 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429202    5872 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429205    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429208    5872 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429210    5872 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429213    5872 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429216    5872 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429218    5872 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429221    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429225    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:29:50.445909 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429228    5872 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429230    5872 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429233    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429236    5872 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429238    5872 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429241    5872 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429245    5872 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429248    5872 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429250    5872 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429253    5872 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429256    5872 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429258    5872 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429261    5872 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429264    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429266    5872 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429269    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429272    5872 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429275    5872 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429279    5872 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:29:50.446431 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429283    5872 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429286    5872 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429288    5872 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429291    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429294    5872 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429297    5872 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429300    5872 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429302    5872 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429305    5872 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429307    5872 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429310    5872 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429312    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429316    5872 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429319    5872 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:50.429322    5872 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.429378    5872 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430334    5872 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430384    5872 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430564    5872 server.go:1014] "Starting client certificate rotation"
Oct 31 07:29:50.446885 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430697    5872 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430736    5872 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:23:37 +0000 UTC" deadline="2028-07-08 17:53:25.874870826 +0000 UTC"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.430772    5872 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14794h23m35.444100913s"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.431030    5872 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.432072    5872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.433274    5872 log.go:25] "Validated CRI v1 runtime API"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.435764    5872 log.go:25] "Validated CRI v1 image API"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.436481    5872 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 07:29:50.447362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.438989    5872 fs.go:135] Filesystem UUIDs: map[56f6dd62-26aa-4f3a-9f58-01d2db616af1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 89f1d931-6eb5-4e12-ae07-87422132c464:/dev/nvme0n1p3]
Oct 31 07:29:50.447591 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.439010    5872 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc/userdata/shm major:0 minor:386 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c/userdata/shm major:0 minor:372 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83/userdata/shm major:0 minor:414 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9/userdata/shm major:0 minor:303 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe/userdata/shm major:0 minor:374 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877/userdata/shm major:0 minor:305 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3e74957c73f6878e37de731fbf6eaaedd5a69fe721e5b1a7e6e1f16e20126bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3e74957c73f6878e37de731fbf6eaaedd5a69fe721e5b1a7e6e1f16e20126bd/userdata/shm major:0 minor:421 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d/userdata/shm major:0 minor:264 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0/userdata/shm major:0 minor:392 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~projected/kube-api-access-4zm74:{mountpoint:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~projected/kube-api-access-4zm74 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~projected/kube-api-access-58l9q:{mountpoint:/var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~projected/kube-api-access-58l9q major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~projected/kube-api-access-ghn89:{mountpoint:/var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~projected/kube-api-access-ghn89 major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~projected/kube-api-access-84qh2:{mountpoint:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~projected/kube-api-access-84qh2 major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/alertmanager/9 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/config-reloader/6 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~empty-dir/config-out major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/kube-api-access-8rhvq:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/kube-api-access-8rhvq major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/tls-assets major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/config-volume major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/web-config major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36fe2da9-e59f-4b74-b99f-d1158fe8a08a/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/36fe2da9-e59f-4b74-b99f-d1158fe8a08a/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3fc55e14-b1ff-4c2e-96c2-81fd385b3987/volumes/kubernetes.io~projected/kube-api-access-r8grg:{mountpoint:/var/lib/kubelet/pods/3fc55e14-b1ff-4c2e-96c2-81fd385b3987/volumes/kubernetes.io~projected/kube-api-access-r8grg major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~projected/kube-api-access-lcf9m:{mountpoint:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~projected/kube-api-access-lcf9m major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/570337d2-bd49-4f21-9f34-eb0a9111aa27/volumes/kubernetes.io~projected/kube-api-access-rcfgh:{mountpoint:/var/lib/kubelet/pods/570337d2-bd49-4f21-9f34-eb0a9111aa27/volumes/kubernetes.io~projected/kube-api-access-rcfgh major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~projected/kube-api-access-h4257:{mountpoint:/var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~projected/kube-api-access-h4257 major:0 minor:385 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:384 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61e2f3ab-4e74-4fcf-834f-76c10bb97f20/volumes/kubernetes.io~projected/kube-api-access-58prx:{mountpoint:/var/lib/kubelet/pods/61e2f3ab-4e74-4fcf-834f-76c10bb97f20/volumes/kubernetes.io~projected/kube-api-access-58prx major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~projected/kube-api-access-kkt7w:{mountpoint:/var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~projected/kube-api-access-kkt7w major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~secret/metrics-certs major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~projected/kube-api-access-jm94h:{mountpoint:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~projected/kube-api-access-jm94h major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:412 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:410 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:411 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e23265d-162b-4b43-9b34-2f66f5cbd362/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/7e23265d-162b-4b43-9b34-2f66f5cbd362/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~projected/kube-api-access-f6tzl:{mountpoint:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~projected/kube-api-access-f6tzl major:0 minor:391 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:389 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:390 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:388 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~projected/kube-api-access-5n6nh:{mountpoint:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~projected/kube-api-access-5n6nh major:0 minor:420 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:419 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:418 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab/volumes/kubernetes.io~projected/kube-api-access-8v4zw:{mountpoint:/var/lib/kubelet/pods/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab/volumes/kubernetes.io~projected/kube-api-access-8v4zw major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cbf450b-951d-4782-9f73-bcbe937a69b7/volumes/kubernetes.io~projected/kube-api-access-krlgw:{mountpoint:/var/lib/kubelet/pods/8cbf450b-951d-4782-9f73-bcbe937a69b7/volumes/kubernetes.io~projected/kube-api-access-krlgw major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~projected/kube-api-access-dh4pv:{mountpoint:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~projected/kube-api-access-dh4pv major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~projected/kube-api-access-5z8bc:{mountpoint:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~projected/kube-api-access-5z8bc major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccc7627c-1675-4147-9ba1-bb9e721b112e/volumes/kubernetes.io~projected/kube-api-access-v6cp7:{mountpoint:/var/lib/kubelet/pods/ccc7627c-1675-4147-9ba1-bb9e721b112e/volumes/kubernetes.io~projected/kube-api-access-v6cp7 major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~projected/kube-api-access-jf4s8:{mountpoint:/var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~projected/kube-api-access-jf4s8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3/volumes/kubernetes.io~secret/tls-certificates major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e08cf711-53da-4c43-8ae1-8a39ea5cce48/volumes/kubernetes.io~projected/kube-api-access-xcszt:{mountpoint:/var/lib/kubelet/pods/e08cf711-53da-4c43-8ae1-8a39ea5cce48/volumes/kubernetes.io~projected/kube-api-access-xcszt major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~projected/kube-api-access-ffc9h:{mountpoint:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~projected/kube-api-access-ffc9h major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~projected/kube-api-access-h6pcw:{mountpoint:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~projected/kube-api-access-h6pcw major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:293 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/a70223574ace71ebe5518c9c377bbae3f26f27f6d4e8227ed9e179ad9b188c19/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/58bc86d74f4a66dfee893d959044a69166bbc34049c83a6cc12c9aa071d1b19e/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/f7b11614ae436b9cc47d1eb8fbbed81a43b1db052244031b3e40d9b9b0454cd4/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/ee8ef699ff3ebb555db89b79d65375d7a58eabadfa33d36df1d964d40e61a63a/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7d0c1a8df51d1bd9e1df925acd47fffe85ac1439b5d32630056d759258a5a946/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/66ff1c9cb23c89cabac38dea5e05b8e4140a9d9ec94ce451106f570dc597d07b/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/7b4ab6c7b6dc9869b3677568e56e5e64799414aa5d3891791a5063496b09ecd4/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/5fd04cd015c7a64b6723315969fa0ec16d8105a255311d8833d69156328a09b5/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/5e646ec176e3583b43906b9d69ecc2a9d2a0a34ac4c2748c82c13388c2a2d558/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/718b748c2fb64b6483149d17cb4afb872761b25ccabcc5b4e1f07b319221525c/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/04c94c00a37376352b3c00c159a4142fe02a4630b4a569d433df746b7d482b1a/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/fb7656e850b99db46ea19016133970a393aee102f9501df79e570f35c22cae05/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/92a1adc4aafc96ed571588e3098230e35c1924404506b259d09659f17dcde9af/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/f55be91b023d97d83209b77306d51b54ae647ac1c954c5e3faab95ae2fd34931/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/32ee96f0bebbc7a74233e775aae8d7c7e6e632d5a91d4ce389ad7bd6b19507f4/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/39564778ec7d50aaf882c48af74b20fcf2475ba0a57e9ecf3727488148d189f5/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1ce358eb234a3447a6e9531006f8b3cd42da552234bf6e0519f1253433cc8300/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/3dfb5639ac239aa70808dcaa7efe6bdc2593da6f4536c85126b3d697f7b9e114/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/84be055494f8c8e2155b6348d86d81e8035ae787bd21094a02f86d7d2f7f6b33/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/96f5f1c1ab51804ecaec9f22c999098db9c20201007c4dc22cd292c0ba422539/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/c6c5f8a7e14210db2c7385581cdd48ab255f93d32dfd8602fd290fb6d2fc9450/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/2ba893680edbcaea78297f152d582f5264dd501856b26611f04e18b96f740942/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/f7df457e29ebffc3daa689fb12b5345dc4adb515669eebc07eb794026e666608/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/d6abbb1fe23db6ba96383a386dcd8bcfdc32ff4201fed84443e595a5a04736d8/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/b0825c4713e0e87dc539fa9be0f7c89d2cae6f02255b55af8ed522ddcfeee6c9/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/3b719359e67687782757b91390d23a156b81746d8313a399114e8cb9cc09d5a5/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/b5448f60a7053d5f263cc4e0ad7907bbfb7f749c6b63bdd725152adbf58ca713/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/250aa5eecbfa8988e32025c84df0ffe9f3d5b76a88ed2e8292e41b3ff05d9970/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/974b14510198ff11485510d003686affff06a0537f16a2eef28cd5f1c49f3cc5/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/092266b729dc51cd169c99dc962c60349c15af04c093304dee44d3ff57d00d49/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/5efb78781e646fed4af581317854f5e9b11ea855a93570e675c20d5abca973c4/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/ab645376946e4c81dacdf3dd2e1bcba7f9586e146600249a445046108f885b4b/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/15166534e9c642d303420cfd4a7e01eb37c899c0dc0f853abadc91c7a45285c3/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/59a14c1060d2a4d4799c4cc82eb04261e43a9dbda38e3dab4d8a251f530717be/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/165385b72eb596b1bd10e1110e1f3cbb271cb5dee42bfee4a9c81d9bacea0012/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/ef99e688f014ea1ca24dc3f92b62ef0121a2fb4a0461d1e7f44ec1eead72beb2/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/99c464f974b60780eea1beb52e40c69ca28b1a2322f2ef68fc4cb15e3d352604/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/ff51ae7f49d8d6d6d42d591642d8674a60da3ded5cd321480fff9c232132e9a8/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/d085224b1bb28823ed5a105e54b498d974c2fcab6b5c2a8340e43f1c1c235e92/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-311:{mountpoint:/var/lib/containers/storage/overlay/157a3dffa64200e4aaff1cd5908150684c2ef1a8e8d0c252cb4eb1564cd88d62/merged major:0 minor:311 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/f699d373291d64eef224bd7d2dc4c82093da2df58c622864649b9216a7b999d4/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/256041bb28ae58a9c86acea649140b19c1715029059df876e22b980cff7c881b/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/7cb4dfde26f64ea2514731be827206791567bf433f794e5f6fec7dd8a9b3db42/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/b2af299083d1aa152c8b5b776b1442d6f216092a337c056f5818fc40bd8b4a7f/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/4d2250eb9ce7f5c8bf4a14462acf92171d93e86f8934e580b50fe3e65625e9f2/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/4782a011032aedef389f5ccef1178bba2357e98840036491155e6cd065738876/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/f5273106532776fc11c943f5a8080b23e713f43a2a60471bb4e03317ac0ffd44/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/f0dd1ab6a3819414253eef6183145d6aa6315fc2e151e0d8e3dc2ec71c66b94d/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/56839522f3a5710d4eec4d0e7f883b70461926f1e270f72aba6e126a0f68dcad/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/78d289aa480c6b48ff34a54b1dddd5b9bacb5672eb7dcc2bfc3af6e2ef636f51/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/1a3d34de6280fcdbe88b40f44d712789c81de32a111e37943ba089c56ce9243d/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/90eb182f62b9c11af78ff040d62aa27da72830f7bf8e197a14567e8a568a4b46/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/b4331b16e5474806a8096d49d334f2e16177b2c1f772f65da9052a6ce3ae93be/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/d4d288282fb79e31d08f03bdf3382824136dfc85c910489b0caedaa30ac4309d/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/99982bb6ff116ae5861ef7ace725ebd1bd288ff5130e9c60770cc4b6a3cf1250/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/a287dd98f5f75a37e7e059af2e7dfd16397b8c04249acf7990868b5225faa90b/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/73751e54dc99fec4b710cddcee30d3a59f40da86d3faa4e5ce972f0d82b1252d/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/cdc672105fdfde0f2de0777824893cdde942af1b480fed1668405b4ad4893298/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/c673b08150dd1665c315598477328a1233572ab00f55c20a22e05f7de2b21cf3/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/e7f44f61dc2d4d81351ef50325ed1a728b7d7e31f77832c19d65865171c69e70/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/2a9ffc6eb28d38a40b23cfa786d1060b468e5e61bcc890a047e18b07eb55664f/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/2282a303ec85db5f626d38ee3c45bd49c337d743926cdc82c78d27f8c74c265f/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-444:{mountpoint:/var/lib/containers/storage/overlay/3ab71eaa2784ab1dc3b8a5d7313864ea3bef9ab34daec0c87666b31bab8a0c38/merged major:0 minor:444 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/a7d56a6fcfbc9e31d70ff1c4da0c99486e3f31b339f73d8fd219f1dbd24b9811/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-454:{mountpoint:/var/lib/containers/storage/overlay/9d7cd9d8982d4a1a79a90e297d2b4386f86fc5538211828fc904939c56e70230/merged major:0 minor:454 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/6a08d05fa620dc580419648f7904b05d4338e405f6eed427d39f12c4177e8143/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/ef042abbc6e2e6f1f4e4f2cab500d02813bb246c5df69501e5852a2f6dc3df14/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-471:{mountpoint:/var/lib/containers/storage/overlay/909931cb0f373fd65c6cd40d1477e2aab70338875d44ca52d5b420aea16cf24a/merged major:0 minor:471 fsType:overlay blockSize:0} overlay_0-477:{mountpoint:/var/lib/containers/storage/overlay/30a33f7f5b81f7e145c46acfcbcf6de02a74c0a1bdb2d01be234c9400907f901/merged major:0 minor:477 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/3756d996b276a3def3f16388c3a5e09a9a53ea9c17acc36eac85addb6ada71f7/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-488:{mountpoint:/var/lib/containers/storage/overlay/540b02fa4170a031d0461a716d015c0f83feb012343fedc95eaae1ca82a7e83f/merged major:0 minor:488 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/2045a79bbe39ea990520b700ae433e8d213d6f29d8b9b6386f8b516875d56467/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-493:{mountpoint:/var/lib/containers/storage/overlay/717392a573be1daf1c29473fccad9740b51b41fc521ac4a69a7b7ccf36c6d175/merged major:0 minor:493 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/b8fb27bc2ef62f98670ade7c61bf0dc0c20e4333b31a6f76967f9a263580ea23/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7d7fcba29511b5600a91f2ebc5c764994c322f504a52994e5711f5cc46897017/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-75:{mountpoint:/var/lib/containers/storage/overlay/0455cdc1367c91302c8e777dff6a8ece260edf8adb00298577ae1a41be1e4045/merged major:0 minor:75 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/2a481382fb6fd47b2ee1fefca1230a3571d384d8bf0e532743a395483f240026/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/811351ac5d567ec03bc84ad43a1fc36cbf03a8ae95d2f11a3b559ee08e4d2d1b/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/86b0d7a23b8c7a56025ce3bbd436616d82f0583627181dc592d6d9280a52f137/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-91:{mountpoint:/var/lib/containers/storage/overlay/b0322d4f8691059656e0166bf8a1bb0afdfbacaf4f1dc9b287b9e22baf4a4d36/merged major:0 minor:91 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/9551da8fd42d42f982035b3e03d7461584b3675087cd6abe03acb3ceb146512d/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/d55764654bcf2b0ac63fa55986bf444c357ac13edb11fae5626d50e1c7cc091e/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 31 07:29:50.449173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.448730    5872 manager.go:217] Machine: {Timestamp:2026-10-31 07:29:50.448247631 +0000 UTC m=+0.060457364 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110803 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ba1e0c49d3c5d8ec052cda4ee39d SystemUUID:ec20ba1e-0c49-d3c5-d8ec-052cda4ee39d BootID:e5f51930-9b2a-48aa-a6a6-49759586546f Filesystems:[{Device:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~projected/kube-api-access-dh4pv DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3fc55e14-b1ff-4c2e-96c2-81fd385b3987/volumes/kubernetes.io~projected/kube-api-access-r8grg DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a25ec0f85eb90116e687db95ab318282fd063deeec9a54945ce9c58ce5afc827/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90d408c35a4ce2355b4037b6cec6a4066307e90d5956c9cd17347d9c763e69b1/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~projected/kube-api-access-ffc9h DeviceMajor:0 DeviceMinor:263 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~projected/kube-api-access-84qh2 DeviceMajor:0 DeviceMinor:297 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:335 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee5479286ddfea305f06d889c9d6f32887d23668ca2e5df81f680c759aab135e/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-75 DeviceMajor:0 DeviceMinor:75 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~projected/kube-api-access-h4257 DeviceMajor:0 DeviceMinor:385 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f19316038e8c4e31c234ec176a586f2ca32d393325279bcf8aefb81beb5cb2b0/userdata/shm DeviceMajor:0 DeviceMinor:392 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:411 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e23265d-162b-4b43-9b34-2f66f5cbd362/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:369 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-488 DeviceMajor:0 DeviceMinor:488 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/334b98b843fea319ab98512d44425c6266f5398596b497181f1af14890edd1f1/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~projected/kube-api-access-ghn89 DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~projected/kube-api-access-5z8bc DeviceMajor:0 DeviceMinor:270 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3e74957c73f6878e37de731fbf6eaaedd5a69fe721e5b1a7e6e1f16e20126bd/userdata/shm DeviceMajor:0 DeviceMinor:421 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7bd99f22b9cd705310a2f2cce79414164c9ec563e03bbc96273a7738e1e37a83/userdata/shm DeviceMajor:0 DeviceMinor:414 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:332 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~projected/kube-api-access-kkt7w DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~projected/kube-api-access-58l9q DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:296 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60fed36f-e2d8-405b-8ce2-d66a797f1472/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:384 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f2c07b950ff45e657fb099b100206d5584333e3d413f0bf929dc706d28a8a966/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75a8c4eb8d6e9f2eb54de4710ceda9e21b815d4b5e7d25fc389c21f7ff8d290d/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:301 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/958faca4-910f-457f-8f09-ce70c47b6fed/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:268 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:300 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:336 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/e08cf711-53da-4c43-8ae1-8a39ea5cce48/volumes/kubernetes.io~projected/kube-api-access-xcszt DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-471 DeviceMajor:0 DeviceMinor:471 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c9c0f70547baca78af0e0cd414d9e0edc5098daf956ad55d7b287c0d1786fd1/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:390 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/570337d2-bd49-4f21-9f34-eb0a9111aa27/volumes/kubernetes.io~projected/kube-api-access-rcfgh DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6fe5443a7878d89143743abd719bddc6375e4da1eef0b81d74531b70ad7d7fe3/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:288 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:418 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/39495c2a6bef2ceb4b3397516ccabd1d881df2e1c67740174337bb81b61745af/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:326 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/47156c140c2042cbd484c5508243e523f22c4287fca18b4747c0209f31ad5b9a/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-311 DeviceMajor:0 DeviceMinor:311 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee7445c3ed9d3af560e6738950d49e8ec5ed96552611f97ee8c3ae2fe0a9d37d/userdata/shm DeviceMajor:0 DeviceMinor:264 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/49854e3c-2db5-4729-9c2f-aca619b2adaa/volumes/kubernetes.io~projected/kube-api-access-lcf9m DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:333 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6320fb1d-596d-4090-aec7-f4d56306d552/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:370 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:332 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-493 DeviceMajor:0 DeviceMinor:493 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/478be85589de467e499fcd5eb072ca1765cd4f171669732587237013a33ee6ef/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:412 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~projected/kube-api-access-jm94h DeviceMajor:0 DeviceMinor:413 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:333 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab/volumes/kubernetes.io~projected/kube-api-access-8v4zw DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d45d8fde-7e93-4d15-96ad-1e5fef70da06/volumes/kubernetes.io~projected/kube-api-access-jf4s8 DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:331 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36fe2da9-e59f-4b74-b99f-d1158fe8a08a/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/966989c4d37e984fe156b72a8e9538cc76872cb67fbfffcfc3a7571409905af0/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:257 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~projected/kube-api-access-h6pcw DeviceMajor:0 DeviceMinor:294 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/58a99b7ac9e9bb8863d2ed22526d26fc5025c48adb003e301ada9a970001cdde/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/25347064-7cf0-4556-a6cd-b4bf8dbd5be7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:330 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~projected/kube-api-access-5n6nh DeviceMajor:0 DeviceMinor:420 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8cbf450b-951d-4782-9f73-bcbe937a69b7/volumes/kubernetes.io~projected/kube-api-access-krlgw DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20905508c1e81e5dad5382c2cdc4f109150c38f83c0cbbc773469771407323cc/userdata/shm DeviceMajor:0 DeviceMinor:386 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:388 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:406 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2af2e3d9-141c-487f-af2e-b1505e4ae1bc/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:295 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b6e691c84434f03b590b4866d3f9845c8b6b352bf3b2ced44dee851eaeed9ac9/userdata/shm DeviceMajor:0 DeviceMinor:303 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~projected/kube-api-access-8rhvq DeviceMajor:0 DeviceMinor:341 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~projected/kube-api-access-f6tzl DeviceMajor:0 DeviceMinor:391 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/61e2f3ab-4e74-4fcf-834f-76c10bb97f20/volumes/kubernetes.io~projected/kube-api-access-58prx DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7913bfb31a782a66d41da8074ce3d9002627b89965137a6a2b72e548674a3f54/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:389 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:419 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~projected/kube-api-access-4zm74 DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:334 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4392790aebfd595ece7b589d587454f85543b53c63f835c8fbee762242afae3c/userdata/shm DeviceMajor:0 DeviceMinor:372 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:333 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24defd82-e512-412f-8982-b02931914bb6/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/24d69252-ed4e-41a4-abc0-018958c37b4d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-91 DeviceMajor:0 DeviceMinor:91 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eaa2361c-1e80-4fec-aca7-57e67cc2c905/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:262 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eae92750-8a5b-4d75-95a7-371bbfc83749/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:293 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3367d02184dc8ed4f0bcef6341fc78fa2fad33f1f5bf3702f0c90d2740b3877/userdata/shm DeviceMajor:0 DeviceMinor:305 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:337 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ccc7627c-1675-4147-9ba1-bb9e721b112e/volumes/kubernetes.io~projected/kube-api-access-v6cp7 DeviceMajor:0 DeviceMinor:371 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:333 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-477 DeviceMajor:0 DeviceMinor:477 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:243 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:269 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c4e29bcac9eb555d95eee7dabd291448a5fb346703c3699088ed61328afc97fe/userdata/shm DeviceMajor:0 DeviceMinor:374 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-444 DeviceMajor:0 DeviceMinor:444 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-454 DeviceMajor:0 DeviceMinor:454 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/726ecee9-61d2-4025-b198-7ff457b6cbbb/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:410 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:187785f40762a36 MacAddress:42:6e:43:12:19:cb Speed:10000 Mtu:8901} {Name:20905508c1e81e5 MacAddress:72:97:a2:e4:a6:12 Speed:10000 Mtu:8901} {Name:39495c2a6bef2ce MacAddress:6a:60:30:35:f4:76 Speed:10000 Mtu:8901} {Name:4392790aebfd595 MacAddress:9e:e2:39:a9:63:56 Speed:10000 Mtu:8901} {Name:47156c140c2042c MacAddress:b6:5f:56:0f:c6:c4 Speed:10000 Mtu:8901} {Name:76f0c33b048f4b5 MacAddress:8e:5f:9d:e7:ff:0f Speed:10000 Mtu:8901} {Name:7bd99f22b9cd705 MacAddress:12:56:d6:30:0d:fd Speed:10000 Mtu:8901} {Name:90d408c35a4ce23 MacAddress:12:ed:d5:6a:b4:9a Speed:10000 Mtu:8901} {Name:966989c4d37e984 MacAddress:de:ad:5c:83:a1:5a Speed:10000 Mtu:8901} {Name:a25ec0f85eb9011 MacAddress:22:be:28:dc:93:ce Speed:10000 Mtu:8901} {Name:b6e691c84434f03 MacAddress:86:6b:3f:8b:7d:4f Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:28:63:3f:89:cf Speed:0 Mtu:9001} {Name:br-int MacAddress:aa:da:10:06:4a:55 Speed:0 Mtu:8901} {Name:c4e29bcac9eb555 MacAddress:66:bc:27:04:36:b0 Speed:10000 Mtu:8901} {Name:d3e74957c73f687 MacAddress:b6:e7:6e:97:99:97 Speed:10000 Mtu:8901} {Name:ee5479286ddfea3 MacAddress:8a:74:62:5b:4b:01 Speed:10000 Mtu:8901} {Name:ee7445c3ed9d3af MacAddress:32:2b:f3:45:a0:61 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:28:63:3f:89:cf Speed:0 Mtu:9001} {Name:f19316038e8c4e3 MacAddress:ae:82:17:8d:e1:37 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:6a:81:3a:c2:62:d7 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:7a:94:1d:88:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 07:29:50.449507 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449177    5872 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 07:29:50.449507 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449228    5872 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 07:29:50.449642 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449607    5872 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 07:29:50.449817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449645    5872 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-145.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 07:29:50.449894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449820    5872 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 07:29:50.449894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449834    5872 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 07:29:50.449894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449852    5872 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:29:50.449894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.449870    5872 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:29:50.450086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450013    5872 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 07:29:50.450247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450234    5872 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 07:29:50.450369 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450358    5872 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 07:29:50.450422 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450403    5872 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 07:29:50.450422 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450418    5872 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 07:29:50.450514 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450434    5872 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 07:29:50.450514 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450447    5872 kubelet.go:405] "Adding apiserver pod source"
Oct 31 07:29:50.450514 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.450459    5872 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 07:29:50.451263 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.451247    5872 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 07:29:50.451263 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.451263    5872 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:29:50.451754 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.451732    5872 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 07:29:50.455853 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.455838    5872 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 07:29:50.455853 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.455851    5872 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:29:50.455962 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.455952    5872 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 07:29:50.456168 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456157    5872 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 07:29:50.456199 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456186    5872 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 07:29:50.456284 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456276    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 07:29:50.456316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456296    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 07:29:50.456357 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456321    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 07:29:50.456357 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456334    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 07:29:50.456357 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456344    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456359    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456370    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456382    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456392    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456398    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456406    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456416    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456451    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 07:29:50.456472 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.456457    5872 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 07:29:50.459870 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.459853    5872 server.go:1263] "Started kubelet"
Oct 31 07:29:50.461289 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.459960    5872 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 07:29:50.461289 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.460647    5872 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 07:29:50.461289 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.460740    5872 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 07:29:50.460604 ip-10-0-140-145 systemd[1]: Started Kubernetes Kubelet.
Oct 31 07:29:50.461568 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.461329    5872 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 07:29:50.465469 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.465447    5872 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 07:29:50.466428 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.466412    5872 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.466542    5872 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.466562    5872 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.466647    5872 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.467709    5872 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.468011    5872 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.468074    5872 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:23:39 +0000 UTC" deadline="2028-06-06 07:04:23.994262296 +0000 UTC"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.468086    5872 factory.go:55] Registering systemd factory
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.468096    5872 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14015h34m33.526171783s"
Oct 31 07:29:50.468316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.468108    5872 factory.go:223] Registration of the systemd container factory successfully
Oct 31 07:29:50.469655 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.469635    5872 factory.go:153] Registering CRI-O factory
Oct 31 07:29:50.469744 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.469658    5872 factory.go:223] Registration of the crio container factory successfully
Oct 31 07:29:50.469744 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.469721    5872 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 07:29:50.469744 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.469741    5872 factory.go:103] Registering Raw factory
Oct 31 07:29:50.469882 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.469757    5872 manager.go:1199] Started watching for new ooms in manager
Oct 31 07:29:50.470163 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470109    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24defd82-e512-412f-8982-b02931914bb6" volumeName="kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470182    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470204    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470219    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cbf450b-951d-4782-9f73-bcbe937a69b7" volumeName="kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470234    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccc7627c-1675-4147-9ba1-bb9e721b112e" volumeName="kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470247    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24defd82-e512-412f-8982-b02931914bb6" volumeName="kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume" seLinuxMountContext=""
Oct 31 07:29:50.470285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470272    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25347064-7cf0-4556-a6cd-b4bf8dbd5be7" volumeName="kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470286    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470304    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470313    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470323    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470333    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470190    5872 manager.go:319] Starting recovery of all containers
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470353    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470366    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470391    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36fe2da9-e59f-4b74-b99f-d1158fe8a08a" volumeName="kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470407    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36fe2da9-e59f-4b74-b99f-d1158fe8a08a" volumeName="kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470439    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e23265d-162b-4b43-9b34-2f66f5cbd362" volumeName="kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470451    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab" volumeName="kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470462    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eae92750-8a5b-4d75-95a7-371bbfc83749" volumeName="kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470473    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="958faca4-910f-457f-8f09-ce70c47b6fed" volumeName="kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470485    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470498    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaa2361c-1e80-4fec-aca7-57e67cc2c905" volumeName="kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470525    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24d69252-ed4e-41a4-abc0-018958c37b4d" volumeName="kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp" seLinuxMountContext=""
Oct 31 07:29:50.470532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470537    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470550    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470562    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="958faca4-910f-457f-8f09-ce70c47b6fed" volumeName="kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470573    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eae92750-8a5b-4d75-95a7-371bbfc83749" volumeName="kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470618    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470635    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470651    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470675    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470687    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e08cf711-53da-4c43-8ae1-8a39ea5cce48" volumeName="kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470698    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470713    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470740    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="570337d2-bd49-4f21-9f34-eb0a9111aa27" volumeName="kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470754    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6320fb1d-596d-4090-aec7-f4d56306d552" volumeName="kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470767    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470791    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="958faca4-910f-457f-8f09-ce70c47b6fed" volumeName="kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470804    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="958faca4-910f-457f-8f09-ce70c47b6fed" volumeName="kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470816    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24d69252-ed4e-41a4-abc0-018958c37b4d" volumeName="kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470850    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24d69252-ed4e-41a4-abc0-018958c37b4d" volumeName="kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470871    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470899    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470911    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470924    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470937    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6320fb1d-596d-4090-aec7-f4d56306d552" volumeName="kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470958    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.470984    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2af2e3d9-141c-487f-af2e-b1505e4ae1bc" volumeName="kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471011    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471024    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471037    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471053    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471065    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab" volumeName="kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471076    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="958faca4-910f-457f-8f09-ce70c47b6fed" volumeName="kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471100    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45d8fde-7e93-4d15-96ad-1e5fef70da06" volumeName="kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471113    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25347064-7cf0-4556-a6cd-b4bf8dbd5be7" volumeName="kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471156    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471172    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471189    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cbf450b-951d-4782-9f73-bcbe937a69b7" volumeName="kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471201    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471213    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471225    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eae92750-8a5b-4d75-95a7-371bbfc83749" volumeName="kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471238    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24defd82-e512-412f-8982-b02931914bb6" volumeName="kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471249    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3fc55e14-b1ff-4c2e-96c2-81fd385b3987" volumeName="kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471261    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471275    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60fed36f-e2d8-405b-8ce2-d66a797f1472" volumeName="kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471288    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60fed36f-e2d8-405b-8ce2-d66a797f1472" volumeName="kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471301    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" volumeName="kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471315    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471329    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaa2361c-1e80-4fec-aca7-57e67cc2c905" volumeName="kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471342    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24defd82-e512-412f-8982-b02931914bb6" volumeName="kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471354    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 07:29:50.471333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471366    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471378    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471389    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471403    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaa2361c-1e80-4fec-aca7-57e67cc2c905" volumeName="kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471414    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eae92750-8a5b-4d75-95a7-371bbfc83749" volumeName="kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471426    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3fc55e14-b1ff-4c2e-96c2-81fd385b3987" volumeName="kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471438    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" volumeName="kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471450    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" volumeName="kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471461    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471474    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471486    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471498    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471512    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" volumeName="kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471525    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471538    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471551    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ede69ed-3423-4f3c-b38a-d14f2fe14d0c" volumeName="kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471562    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471575    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471588    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45d8fde-7e93-4d15-96ad-1e5fef70da06" volumeName="kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471599    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eaa2361c-1e80-4fec-aca7-57e67cc2c905" volumeName="kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471612    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25347064-7cf0-4556-a6cd-b4bf8dbd5be7" volumeName="kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471626    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25347064-7cf0-4556-a6cd-b4bf8dbd5be7" volumeName="kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471640    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49854e3c-2db5-4729-9c2f-aca619b2adaa" volumeName="kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471659    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471671    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" volumeName="kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471683    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab" volumeName="kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471693    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471707    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322020da-5e53-456f-89cb-96195b99f662" volumeName="kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471721    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="570337d2-bd49-4f21-9f34-eb0a9111aa27" volumeName="kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471733    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="726ecee9-61d2-4025-b198-7ff457b6cbbb" volumeName="kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471744    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8607ba6-919e-47c5-901f-72b2d969a14d" volumeName="kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471756    5872 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3" volumeName="kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates" seLinuxMountContext=""
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471768    5872 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 07:29:50.473634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.471775    5872 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 07:29:50.499692 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.499627    5872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 07:29:50.501764 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.501740    5872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 07:29:50.501764 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.501765    5872 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 07:29:50.501934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.501785    5872 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 07:29:50.501934 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.501822    5872 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 07:29:50.523299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523268    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="ea57c5d769ca4c362e5b7de5dbf68f80caaf85d62e2d40e1a7bbc83e101833e6" exitCode=0
Oct 31 07:29:50.523299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523294    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="9bd3cbffc3531c5e88627778b56dc4dbd4c406d9573fb6f9bcd1ae314a61ab6b" exitCode=0
Oct 31 07:29:50.523299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523303    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="0a48dd73d0294af94432748a5d8574ec3e565910353539370afd11d1ec93e011" exitCode=0
Oct 31 07:29:50.523486 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523309    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="941efff3f1d275efde55c9cbd32b32a575b61b7eacb834707562150f3504fe70" exitCode=0
Oct 31 07:29:50.523486 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523315    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="592c641b49d997344b611f6b3afd9eaae421c1dd3a71c5f4ef5b77071fec71d1" exitCode=0
Oct 31 07:29:50.523486 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.523320    5872 generic.go:356] "Generic (PLEG): container finished" podID="61e2f3ab-4e74-4fcf-834f-76c10bb97f20" containerID="550ac44d58e2e4c884d2a8e7adf2804d2e4ff5d0094bc93685a137c1e1014279" exitCode=0
Oct 31 07:29:50.526079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.526055    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:29:50.527200 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.527181    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:29:50.552461 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.552439    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:29:50.552794 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.552762    5872 generic.go:356] "Generic (PLEG): container finished" podID="958faca4-910f-457f-8f09-ce70c47b6fed" containerID="9288ca99c668d4c4478d35353ceea105d94239424403c7a1c52a9b060b622538" exitCode=1
Oct 31 07:29:50.558220 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.558196    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf" exitCode=0
Oct 31 07:29:50.567873 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.567849    5872 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:29:50.570603 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.570581    5872 generic.go:356] "Generic (PLEG): container finished" podID="8c2d27ecaeaabe5b2e48a361bbe98176" containerID="541680c5238aee69c1c1ddc0bb76a12e1dc54727ba3821f9f14df8848b36c994" exitCode=0
Oct 31 07:29:50.574375 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.574338    5872 generic.go:356] "Generic (PLEG): container finished" podID="49854e3c-2db5-4729-9c2f-aca619b2adaa" containerID="8d4229e03ad911309592657c947b30da1aeb341ff785571d3009359335a27bf6" exitCode=0
Oct 31 07:29:50.595430 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.595379    5872 manager.go:324] Recovery completed
Oct 31 07:29:50.601895 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.601872    5872 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 31 07:29:50.618943 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.618922    5872 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:29:50.621778 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.621758    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:29:50.621845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.621786    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:29:50.621845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.621798    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:29:50.624849 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.624831    5872 cpu_manager.go:226] "Starting" policy="none"
Oct 31 07:29:50.624849 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.624845    5872 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:29:50.625001 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.624848    5872 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 07:29:50.625001 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.624925    5872 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 07:29:50.625133 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625117    5872 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 07:29:50.625186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625134    5872 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 07:29:50.625186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625160    5872 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 07:29:50.625186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625170    5872 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 07:29:50.625186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625178    5872 policy_none.go:50] "Start"
Oct 31 07:29:50.625368 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625194    5872 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 07:29:50.625368 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625208    5872 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 07:29:50.625467 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625389    5872 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 07:29:50.625467 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625401    5872 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 07:29:50.625467 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625409    5872 policy_none.go:44] "Start"
Oct 31 07:29:50.625926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625911    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:29:50.626028 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625939    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:29:50.626028 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.625955    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:29:50.630430 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.630399    5872 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 07:29:50.633597 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.633583    5872 manager.go:341] "Starting Device Plugin manager"
Oct 31 07:29:50.633677 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.633623    5872 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 07:29:50.633677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.633634    5872 server.go:87] "Starting device plugin registration server"
Oct 31 07:29:50.633982 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.633951    5872 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 07:29:50.634024 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.633981    5872 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 07:29:50.634091 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.634076    5872 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 07:29:50.635695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.634202    5872 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 07:29:50.635695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.634273    5872 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 07:29:50.635695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.634282    5872 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 07:29:50.635695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.634326    5872 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:29:50.634259439Z","UUID":"36ac3f83-f488-4119-a39d-f601cee62979","Handler":null,"Name":"","Endpoint":""}
Oct 31 07:29:50.635894 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.635789    5872 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 07:29:50.635894 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.635837    5872 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-145.us-west-1.compute.internal\" not found"
Oct 31 07:29:50.636565 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.636547    5872 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 07:29:50.636645 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.636573    5872 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 07:29:50.663640 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.663612    5872 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:29:50.664231 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.664208    5872 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:29:50.664328 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.664306    5872 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 07:29:50.664328 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.664311    5872 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:29:50.734612 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.734583    5872 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:29:50.735725 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.735706    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 31 07:29:50.735814 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.735742    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 07:29:50.735814 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.735754    5872 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-145.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 31 07:29:50.735814 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.735802    5872 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.762650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.762623    5872 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:29:50.802290 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.802231    5872 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"]
Oct 31 07:29:50.803023 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803002    5872 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.803140 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803049    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"9d8d2bd7442930f2267d92c4a39b2cf9","Type":"ContainerStarted","Data":"c33ffe9ae1d67a6bc727087d0be4c8e26fb8299d1f5c6e4b4f91f4732ab749cf"}
Oct 31 07:29:50.803140 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803103    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"9d8d2bd7442930f2267d92c4a39b2cf9","Type":"ContainerStarted","Data":"a8e1a4a7a7033bbade617f32b4a35c3423c0aa86d48e01d9e4737761e86a7359"}
Oct 31 07:29:50.803140 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803123    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerStarted","Data":"172f79cef32b5c21c01f99f1a0b476596a42ba273ba4addadacf0b223b05a184"}
Oct 31 07:29:50.803288 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803142    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerDied","Data":"541680c5238aee69c1c1ddc0bb76a12e1dc54727ba3821f9f14df8848b36c994"}
Oct 31 07:29:50.803288 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803161    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal" event={"ID":"8c2d27ecaeaabe5b2e48a361bbe98176","Type":"ContainerStarted","Data":"c06d64f165ae6eb88efa257aedf39ccf5e7f68502f0f5c31e3a779db2e96b653"}
Oct 31 07:29:50.803288 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.803213    5872 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.866658 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.866590    5872 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:29:50.866658 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.866648    5872 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.866936 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.866919    5872 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:29:50.867004 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:50.866958    5872 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.870317 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.870299    5872 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.870370 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.870360    5872 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.965862 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.965831    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.966047 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.965867    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:50.966047 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:50.965886    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066480 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066445    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066500    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066525    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066457    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066572    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8d2bd7442930f2267d92c4a39b2cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"9d8d2bd7442930f2267d92c4a39b2cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.066637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.066583    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2d27ecaeaabe5b2e48a361bbe98176-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" (UID: \"8c2d27ecaeaabe5b2e48a361bbe98176\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.450863 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.450825    5872 apiserver.go:52] "Watching apiserver"
Oct 31 07:29:51.555109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.555081    5872 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 07:29:51.555787 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.555757    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w","openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv","openshift-monitoring/telemeter-client-c79f89bf5-z6bkf","openshift-ovn-kubernetes/ovnkube-node-t7mvb","kube-system/konnectivity-agent-rhw4q","openshift-console/console-5ccc758886-fc48j","openshift-image-registry/node-ca-65p5r","openshift-dns/dns-default-tlqmn","openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f","openshift-multus/multus-dpqwq","openshift-monitoring/node-exporter-q2v75","openshift-monitoring/alertmanager-main-0","kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-j7x5v","openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk","openshift-console/console-668bb4fc5d-sd6w7","openshift-multus/multus-additional-cni-plugins-7rdr6","openshift-network-operator/iptables-alerter-nlw2n","openshift-insights/insights-runtime-extractor-j5d2p","kube-system/global-pull-secret-syncer-mlgpz","openshift-monitoring/metrics-server-667fc5fff6-zmrzv","openshift-network-diagnostics/network-check-target-f6dr5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh","openshift-cluster-node-tuning-operator/tuned-blhz6","openshift-dns/node-resolver-xrmzc","openshift-monitoring/prometheus-operator-9cd89b74c-8dn96","openshift-ingress-canary/ingress-canary-mqws7"]
Oct 31 07:29:51.569329 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569304    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.569329 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569332    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.569490 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569351    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.569490 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569366    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.569593 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569483    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.569593 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569524    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.569687 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569595    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.569687 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569633    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.569687 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569659    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569682    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-tmp\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569684    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569721    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569749    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569764    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570337d2-bd49-4f21-9f34-eb0a9111aa27-tmp-dir\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569777    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569793    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.569817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569808    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569845    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.569980    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570032    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570055    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570073    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570096    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570118    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570163    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-textfile\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.570173 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570161    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm74\" (UniqueName: \"kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570207    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570290    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570321    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570359    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570384    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570469    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf4s8\" (UniqueName: \"kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570507    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.570547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570536    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570577    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570605    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570635    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570670    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570716    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570750    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlgw\" (UniqueName: \"kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570798    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570829    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghn89\" (UniqueName: \"kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570856    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.570929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.570892    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571005    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571027    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4pv\" (UniqueName: \"kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571042    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571062    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571103    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571129    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571168    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571208    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571235    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571288    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571295    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571331    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sf77f\" (UID: \"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571444    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.571515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571492    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571554    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571587    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571606    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571634    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571680    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571720    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571824    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.571922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571901    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkt7w\" (UniqueName: \"kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571935    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.571994    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58l9q\" (UniqueName: \"kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572030    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572091    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572122    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572161    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572207    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.572227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572227    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.572433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572266    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:51.572433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572283    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfgh\" (UniqueName: \"kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.572433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572310    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.572433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572328    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.572433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572353    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.572760 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572747    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcszt\" (UniqueName: \"kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.572793 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572771    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.572793 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572788    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.572850 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572804    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.572850 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572820    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcf9m\" (UniqueName: \"kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.572850 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572834    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.572929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572880    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.572958 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572941    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.573009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572962    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:29:51.573009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.572996    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58prx\" (UniqueName: \"kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.573062 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573022    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.573062 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573038    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.573062 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573052    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.573149 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573076    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffc9h\" (UniqueName: \"kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.573191 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573174    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.573245 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573233    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.573323 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573301    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.573323 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573325    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.573463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573342    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.573463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573361    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.573463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573389    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.573463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573456    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.573580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573478    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.573580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573491    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-tuned\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.573580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573506    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.573580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573524    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.573580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573580    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24defd82-e512-412f-8982-b02931914bb6-tmp-dir\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.573724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573595    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8grg\" (UniqueName: \"kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.573724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573618    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.573724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573653    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.573875 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573736    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.573875 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573780    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.573875 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573821    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.573875 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573836    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-data-volume\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.573875 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573853    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573881    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573908    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573936    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.573958    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.574011    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.574081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.574059    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4zw\" (UniqueName: \"kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.578709 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.578691    5872 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.578834 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.578820    5872 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.609684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.609650    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w8pvl\""
Oct 31 07:29:51.609684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.609670    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5qqnh\""
Oct 31 07:29:51.609844 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.609700    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gttml\""
Oct 31 07:29:51.610020 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610002    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 07:29:51.610090 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610003    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 07:29:51.610090 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610024    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.610090 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610027    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 07:29:51.610090 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610029    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 07:29:51.610273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610133    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-798mv\""
Oct 31 07:29:51.610273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610149    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.610273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610189    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.610273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610200    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.610273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610215    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.610498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610346    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.610498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610426    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 07:29:51.610498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610452    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.610600 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610514    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 07:29:51.610684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610667    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jtbjn\""
Oct 31 07:29:51.610758 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610742    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwql\""
Oct 31 07:29:51.610821 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.610768    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.611218 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611198    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.611306 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611269    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-config\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.611306 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611282    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 07:29:51.611544 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611519    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.611696 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611650    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.611767 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611706    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kwsqb\""
Oct 31 07:29:51.611999 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611961    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.611999 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.611992    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-crxcw\""
Oct 31 07:29:51.612203 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612178    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.612302 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612286    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.612354 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612321    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7fk4f\""
Oct 31 07:29:51.612464 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612444    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 07:29:51.612572 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612513    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 07:29:51.612572 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.612517    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 07:29:51.614284 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.614260    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-env-overrides\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.614500 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.614480    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-konnectivity-ca\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:29:51.614709 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.614690    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/958faca4-910f-457f-8f09-ce70c47b6fed-ovnkube-script-lib\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.615235 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615210    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 07:29:51.615334 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615316    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvmcp\""
Oct 31 07:29:51.615391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615353    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ldrdc\""
Oct 31 07:29:51.615440 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615408    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 07:29:51.615522 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615507    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 07:29:51.615564 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615550    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 07:29:51.615687 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615673    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.615742 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615694    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46dh7\""
Oct 31 07:29:51.615790 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615749    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 07:29:51.615790 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.615782    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.620404 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.620383    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36fe2da9-e59f-4b74-b99f-d1158fe8a08a-agent-certs\") pod \"konnectivity-agent-rhw4q\" (UID: \"36fe2da9-e59f-4b74-b99f-d1158fe8a08a\") " pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:29:51.620475 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.620451    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e23265d-162b-4b43-9b34-2f66f5cbd362-original-pull-secret\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.620608 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.620595    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/958faca4-910f-457f-8f09-ce70c47b6fed-ovn-node-metrics-cert\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.620714 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.620696    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-serviceca\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.620714 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.620711    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6320fb1d-596d-4090-aec7-f4d56306d552-metrics-certs\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:51.621538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.621521    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.622718 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.622700    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-daemon-config\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.622771 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.622700    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cni-binary-copy\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.622771 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.622760    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.625003 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.624987    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.625070 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.625001    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf450b-951d-4782-9f73-bcbe937a69b7-iptables-alerter-script\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.647280 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647256    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 07:29:51.647376 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647363    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-m5kd5\""
Oct 31 07:29:51.647411 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647396    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 07:29:51.647473 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647463    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g5szt\""
Oct 31 07:29:51.647730 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647710    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 07:29:51.647809 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647738    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.647910 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647898    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.647952 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647934    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 07:29:51.648033 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647951    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xb4h7\""
Oct 31 07:29:51.648033 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.647996    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 07:29:51.648033 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.648002    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.648132 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.648033    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.648132 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.648106    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g75wk\""
Oct 31 07:29:51.650253 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.650237    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24defd82-e512-412f-8982-b02931914bb6-config-volume\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.653524 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.653508    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24defd82-e512-412f-8982-b02931914bb6-metrics-tls\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.653576 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.653508    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45d8fde-7e93-4d15-96ad-1e5fef70da06-cert\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:51.653576 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.653534    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.653576 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.653563    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.659940 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.659925    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 07:29:51.662109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.662094    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.664443 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.664420    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zm74\" (UniqueName: \"kubernetes.io/projected/24d69252-ed4e-41a4-abc0-018958c37b4d-kube-api-access-4zm74\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.664517 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.664460    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8grg\" (UniqueName: \"kubernetes.io/projected/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-kube-api-access-r8grg\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.664517 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.664419    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlgw\" (UniqueName: \"kubernetes.io/projected/8cbf450b-951d-4782-9f73-bcbe937a69b7-kube-api-access-krlgw\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.664838 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.664823    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcszt\" (UniqueName: \"kubernetes.io/projected/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kube-api-access-xcszt\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.664938 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.664923    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf4s8\" (UniqueName: \"kubernetes.io/projected/d45d8fde-7e93-4d15-96ad-1e5fef70da06-kube-api-access-jf4s8\") pod \"ingress-canary-mqws7\" (UID: \"d45d8fde-7e93-4d15-96ad-1e5fef70da06\") " pod="openshift-ingress-canary/ingress-canary-mqws7"
Oct 31 07:29:51.665624 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.665607    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghn89\" (UniqueName: \"kubernetes.io/projected/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-kube-api-access-ghn89\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.665998 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.665957    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkt7w\" (UniqueName: \"kubernetes.io/projected/6320fb1d-596d-4090-aec7-f4d56306d552-kube-api-access-kkt7w\") pod \"network-metrics-daemon-j7x5v\" (UID: \"6320fb1d-596d-4090-aec7-f4d56306d552\") " pod="openshift-multus/network-metrics-daemon-j7x5v"
Oct 31 07:29:51.666066 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.665994    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58l9q\" (UniqueName: \"kubernetes.io/projected/24defd82-e512-412f-8982-b02931914bb6-kube-api-access-58l9q\") pod \"dns-default-tlqmn\" (UID: \"24defd82-e512-412f-8982-b02931914bb6\") " pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:51.666346 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.666331    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6cp7\" (UniqueName: \"kubernetes.io/projected/ccc7627c-1675-4147-9ba1-bb9e721b112e-kube-api-access-v6cp7\") pod \"network-check-target-f6dr5\" (UID: \"ccc7627c-1675-4147-9ba1-bb9e721b112e\") " pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:29:51.667135 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.667109    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58prx\" (UniqueName: \"kubernetes.io/projected/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-kube-api-access-58prx\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.667225 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.667186    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfgh\" (UniqueName: \"kubernetes.io/projected/570337d2-bd49-4f21-9f34-eb0a9111aa27-kube-api-access-rcfgh\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.667353 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.667337    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4zw\" (UniqueName: \"kubernetes.io/projected/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-kube-api-access-8v4zw\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.667675 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.667658    5872 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:29:51.667742 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:51.667714    5872 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.667941 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.667926    5872 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:29:51.668027 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:29:51.667961    5872 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 07:29:51.668202 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.668181    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4pv\" (UniqueName: \"kubernetes.io/projected/958faca4-910f-457f-8f09-ce70c47b6fed-kube-api-access-dh4pv\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.668618 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.668604    5872 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 07:29:51.674781 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674762    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.674830 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674789    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.674830 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674806    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.674926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674830    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6tzl\" (UniqueName: \"kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.674926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674862    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-multus\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.674926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674855    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.674926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674866    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-etc-kubernetes\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.674926 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674887    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-systemd-units\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674935    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675005    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-log-socket\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.674958    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675043    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675062    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-kubernetes\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675067    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675092    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675101    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675116    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675141    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675143    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fc55e14-b1ff-4c2e-96c2-81fd385b3987-host\") pod \"node-ca-65p5r\" (UID: \"3fc55e14-b1ff-4c2e-96c2-81fd385b3987\") " pod="openshift-image-registry/node-ca-65p5r"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675153    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-var-lib-kubelet\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675169    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675186    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675189    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675202    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675224    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-audit-log\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675224    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675239    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf450b-951d-4782-9f73-bcbe937a69b7-host-slash\") pod \"iptables-alerter-nlw2n\" (UID: \"8cbf450b-951d-4782-9f73-bcbe937a69b7\") " pod="openshift-network-operator/iptables-alerter-nlw2n"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675248    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675264    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675266    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-host\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675273    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-node-log\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675271 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675280    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675298    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-multus-certs\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675305    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-k8s-cni-cncf-io\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675332    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675368    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-dbus\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675394    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675411    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675455    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25347064-7cf0-4556-a6cd-b4bf8dbd5be7-crio-socket\") pod \"insights-runtime-extractor-j5d2p\" (UID: \"25347064-7cf0-4556-a6cd-b4bf8dbd5be7\") " pod="openshift-insights/insights-runtime-extractor-j5d2p"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675468    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675522    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675538    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675553    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm94h\" (UniqueName: \"kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675573    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675595    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675612    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675628    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675643    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675662    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-device-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675673    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675686    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/570337d2-bd49-4f21-9f34-eb0a9111aa27-hosts-file\") pod \"node-resolver-xrmzc\" (UID: \"570337d2-bd49-4f21-9f34-eb0a9111aa27\") " pod="openshift-dns/node-resolver-xrmzc"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675717    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675719    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-lib-modules\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675743    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-kubelet\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675783    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675816    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675840    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675851    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675865    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-var-lib-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675880    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675888    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-socket-dir-parent\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.675986 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.675903    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676008    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-system-cni-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676045    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676062    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676077    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676096    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676123    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-root\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676124    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676152    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676166    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676181    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676196    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676211    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676225    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676240    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676239    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-modprobe-d\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676270    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-systemd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676306    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-sys\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676379    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676400    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676409    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-sys\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676417    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676433    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-netd\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676435    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676458    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676474    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4257\" (UniqueName: \"kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676483    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-systemd\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676490    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676505    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676521    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676536    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676551    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676573    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676590    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676606    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676638    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676629    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676659    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676674    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676690    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676707    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676723    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676740    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676756    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676772    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676790    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6pcw\" (UniqueName: \"kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676805    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676822    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676825    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676837    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qh2\" (UniqueName: \"kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676858    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.676859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676873    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676890    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676907    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676909    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-multus-conf-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676928    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676945    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.676961    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677010    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677036    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677054    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-cni-bin\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677065    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysconfig\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677074    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-cnibin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677092    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-run\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677113    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677142    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-kubelet\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677170    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-system-cni-dir\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677172    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677228    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-slash\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677247    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677273    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-registration-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677276    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677285    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-etc-openvswitch\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677305    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677326    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677361    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677376    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677393    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677414    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677421    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-run-netns\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677430    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677428    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-hostroot\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677428    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677472    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-run-netns\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677476    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e23265d-162b-4b43-9b34-2f66f5cbd362-kubelet-config\") pod \"global-pull-secret-syncer-mlgpz\" (UID: \"7e23265d-162b-4b43-9b34-2f66f5cbd362\") " pod="kube-system/global-pull-secret-syncer-mlgpz"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677490    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-socket-dir\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677493    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677515    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677534    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677554    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677568    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677597    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab-host-var-lib-cni-bin\") pod \"multus-dpqwq\" (UID: \"859bca1d-5fb6-4bac-9d0c-f9ab6ea99aab\") " pod="openshift-multus/multus-dpqwq"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677607    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677627    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677649    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677660    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e2f3ab-4e74-4fcf-834f-76c10bb97f20-cnibin\") pod \"multus-additional-cni-plugins-7rdr6\" (UID: \"61e2f3ab-4e74-4fcf-834f-76c10bb97f20\") " pod="openshift-multus/multus-additional-cni-plugins-7rdr6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677664    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677668    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24d69252-ed4e-41a4-abc0-018958c37b4d-etc-sysctl-conf\") pod \"tuned-blhz6\" (UID: \"24d69252-ed4e-41a4-abc0-018958c37b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-blhz6"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677690    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/958faca4-910f-457f-8f09-ce70c47b6fed-run-ovn\") pod \"ovnkube-node-t7mvb\" (UID: \"958faca4-910f-457f-8f09-ce70c47b6fed\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677713    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e08cf711-53da-4c43-8ae1-8a39ea5cce48-sys-fs\") pod \"aws-ebs-csi-driver-node-bh2mh\" (UID: \"e08cf711-53da-4c43-8ae1-8a39ea5cce48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh2mh"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677718    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677736    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677751    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677769    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677785    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.678530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.677853    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-wtmp\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.706377 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706289    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 31 07:29:51.706377 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706357    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 07:29:51.706520 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706508    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ss6lb\""
Oct 31 07:29:51.706580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706566    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wsq7b\""
Oct 31 07:29:51.706923 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706904    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 07:29:51.707014 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.706977    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 07:29:51.707262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707231    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 07:29:51.707337 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707277    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 07:29:51.707498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707473    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 07:29:51.707498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707479    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707503    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707511    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707511    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cznnw\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707515    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707533    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2gp55\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707593    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-federate-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707606    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 07:29:51.707650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707636    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707712    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707711    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707712    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707719    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707781    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707791    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707798    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nz7mc\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707825    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cs9d6\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707834    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707835    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707851    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jt2g5\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707892    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707929    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pqqq4\""
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707977    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.708006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.707987    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-146lfq86k66ve\""
Oct 31 07:29:51.708448 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.708038    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 31 07:29:51.708448 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.708080    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 31 07:29:51.708448 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.708164    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 31 07:29:51.708448 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.708215    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c7ffn\""
Oct 31 07:29:51.709816 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.709800    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.709890 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.709852    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 31 07:29:51.709961 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.709909    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.709961 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710008    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaa2361c-1e80-4fec-aca7-57e67cc2c905-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.710174 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710150    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 07:29:51.710264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710186    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.710264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710222    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 07:29:51.710264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710187    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 31 07:29:51.710264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710244    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 31 07:29:51.710413 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710265    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 31 07:29:51.710413 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710270    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 07:29:51.710413 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710286    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 07:29:51.710584 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710569    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 31 07:29:51.710822 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710803    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 07:29:51.710915 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710899    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 07:29:51.710955 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.710933    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.711020 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.711002    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.711165 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.711150    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-tls\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.712336 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.712321    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sf77f\" (UID: \"d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:51.713480 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.713458    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.713662 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.713646    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2361c-1e80-4fec-aca7-57e67cc2c905-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.713707 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.713693    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49854e3c-2db5-4729-9c2f-aca619b2adaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.714086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.714070    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.714662 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.714647    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.715018 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.714964    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcf9m\" (UniqueName: \"kubernetes.io/projected/49854e3c-2db5-4729-9c2f-aca619b2adaa-kube-api-access-lcf9m\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.715145 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.715131    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.715632 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.715616    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60fed36f-e2d8-405b-8ce2-d66a797f1472-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:51.715734 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.715721    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.715854 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.715840    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.715980 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.715946    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.716290 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716274    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffc9h\" (UniqueName: \"kubernetes.io/projected/eaa2361c-1e80-4fec-aca7-57e67cc2c905-kube-api-access-ffc9h\") pod \"prometheus-operator-9cd89b74c-8dn96\" (UID: \"eaa2361c-1e80-4fec-aca7-57e67cc2c905\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8dn96"
Oct 31 07:29:51.716449 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716432    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-client-certs\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.716533 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716516    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.716571 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716526    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.716571 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716544    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.716571 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716526    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae92750-8a5b-4d75-95a7-371bbfc83749-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.716659 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716621    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-metrics-client-ca\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.716737 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716662    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.716737 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716692    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.716737 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716723    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.716833 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.716753    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.717157 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717135    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-secret-telemeter-client\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.717335 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717316    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-serving-certs-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.717335 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717331    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.717453 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717401    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.717453 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717404    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-client-tls\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.717553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717478    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.717553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717494    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.717553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717512    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-metrics-server-audit-profiles\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.717553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717512    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.717553 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717542    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.717703 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717587    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-secret-metrics-server-tls\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.717734 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717711    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae92750-8a5b-4d75-95a7-371bbfc83749-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.717854 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717834    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.717959 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717944    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.718015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717980    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.718015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.717984    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-client-ca-bundle\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.719857 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.719836    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"console-5ccc758886-fc48j\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") " pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:29:51.719927 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.719916    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49854e3c-2db5-4729-9c2f-aca619b2adaa-metrics-client-ca\") pod \"node-exporter-q2v75\" (UID: \"49854e3c-2db5-4729-9c2f-aca619b2adaa\") " pod="openshift-monitoring/node-exporter-q2v75"
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.757519    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.757840    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758059    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758381    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm94h\" (UniqueName: \"kubernetes.io/projected/726ecee9-61d2-4025-b198-7ff457b6cbbb-kube-api-access-jm94h\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758395    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.758458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758398    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4257\" (UniqueName: \"kubernetes.io/projected/60fed36f-e2d8-405b-8ce2-d66a797f1472-kube-api-access-h4257\") pod \"monitoring-plugin-77f4f76594-gdmrv\" (UID: \"60fed36f-e2d8-405b-8ce2-d66a797f1472\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:51.758724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758472    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6pcw\" (UniqueName: \"kubernetes.io/projected/eae92750-8a5b-4d75-95a7-371bbfc83749-kube-api-access-h6pcw\") pod \"openshift-state-metrics-7bd7489957-drb5w\" (UID: \"eae92750-8a5b-4d75-95a7-371bbfc83749\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-drb5w"
Oct 31 07:29:51.758724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758504    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qh2\" (UniqueName: \"kubernetes.io/projected/2af2e3d9-141c-487f-af2e-b1505e4ae1bc-kube-api-access-84qh2\") pod \"kube-state-metrics-5dc8d7d89b-6ncgk\" (UID: \"2af2e3d9-141c-487f-af2e-b1505e4ae1bc\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-6ncgk"
Oct 31 07:29:51.758724 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758582    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:51.758811 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.758766    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6tzl\" (UniqueName: \"kubernetes.io/projected/7ede69ed-3423-4f3c-b38a-d14f2fe14d0c-kube-api-access-f6tzl\") pod \"metrics-server-667fc5fff6-zmrzv\" (UID: \"7ede69ed-3423-4f3c-b38a-d14f2fe14d0c\") " pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:51.766766 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.766742    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:29:51.767895 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.767870    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/726ecee9-61d2-4025-b198-7ff457b6cbbb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c79f89bf5-z6bkf\" (UID: \"726ecee9-61d2-4025-b198-7ff457b6cbbb\") " pod="openshift-monitoring/telemeter-client-c79f89bf5-z6bkf"
Oct 31 07:29:51.768301 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:51.768282    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"console-668bb4fc5d-sd6w7\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") " pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:52.353112 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:52.353078    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:29:52.400009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:52.399981    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:29:52.866252 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:52.866221    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlqmn"
Oct 31 07:29:53.243300 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:53.243269    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rhw4q"
Oct 31 07:29:54.960626 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:54.960591    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sf77f"
Oct 31 07:29:55.792679 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.792648    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:29:55.797551 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.797534    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.900341 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.900303    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:29:55.920308 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920277    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920457 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920320    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920457 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920338    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920457 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920446    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920556 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920470    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920556 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920488    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920617 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920594    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:55.920647 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:55.920633    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84kb2\" (UniqueName: \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022060 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022022    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022060 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022065    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022083    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022105    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022126    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022226    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022302    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022460    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84kb2\" (UniqueName: \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.022558 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022504    5872 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 07:29:56.022912 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022753    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.023232 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.022962    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.023232 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.023005    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.023232 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.023010    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.023402 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.023384    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.024821 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.024799    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.024943 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.024927    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.079780 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.079715    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84kb2\" (UniqueName: \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\") pod \"console-5484f5bdb4-2wwtm\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") " pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.108401 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.108372    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:56.484290 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.484240    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:29:56.487929 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:29:56.487897    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39576cb3_303d_4207_8b58_9500f7b0a6c0.slice/crio-d58947cc45a1a363ffd4026d355f7da5184a298a0069bc686a4972b96602a027 WatchSource:0}: Error finding container d58947cc45a1a363ffd4026d355f7da5184a298a0069bc686a4972b96602a027: Status 404 returned error can't find the container with id d58947cc45a1a363ffd4026d355f7da5184a298a0069bc686a4972b96602a027
Oct 31 07:29:56.582516 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.582485    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:29:56.601960 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.601920    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5484f5bdb4-2wwtm" event={"ID":"39576cb3-303d-4207-8b58-9500f7b0a6c0","Type":"ContainerStarted","Data":"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"}
Oct 31 07:29:56.602164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.601990    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5484f5bdb4-2wwtm" event={"ID":"39576cb3-303d-4207-8b58-9500f7b0a6c0","Type":"ContainerStarted","Data":"d58947cc45a1a363ffd4026d355f7da5184a298a0069bc686a4972b96602a027"}
Oct 31 07:29:56.930311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:56.930247    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5484f5bdb4-2wwtm" podStartSLOduration=1.9302309100000001 podStartE2EDuration="1.93023091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:56.9295205 +0000 UTC m=+6.541730242" watchObservedRunningTime="2026-10-31 07:29:56.93023091 +0000 UTC m=+6.542440724"
Oct 31 07:29:58.341313 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:58.341274    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:58.346095 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:58.346074    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:29:58.862089 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:58.862008    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:58.866548 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:58.866527    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-gdmrv"
Oct 31 07:29:59.356843 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:59.356794    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:59.362700 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:59.362678    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:29:59.614817 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:59.614751    5872 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:29:59.840117 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:29:59.840081    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:30:00.870491 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:00.870453    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:30:00.994195 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:00.994167    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:30:00.994445 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:00.994430    5872 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:30:01.228751 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:01.228724    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:30:05.610394 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:05.610352    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:30:05.610888 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:05.610489    5872 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:30:05.614400 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:05.614379    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:30:05.778668 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:05.778633    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:30:06.223823 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:06.223790    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:30:10.530308 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:30:10.530261    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:30:16.587107 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:16.587075    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:30:16.590684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:16.590664    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-667fc5fff6-zmrzv"
Oct 31 07:30:17.601593 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:17.601550    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5ccc758886-fc48j" podUID="b8607ba6-919e-47c5-901f-72b2d969a14d" containerName="console" containerID="cri-o://f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121" gracePeriod=15
Oct 31 07:30:17.865306 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:17.865245    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:30:18.014792 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.014762    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.014943 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.014812    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.014943 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.014851    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.014943 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.014875    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.015067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015048    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.015135 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015115    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.015195 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015165    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") pod \"b8607ba6-919e-47c5-901f-72b2d969a14d\" (UID: \"b8607ba6-919e-47c5-901f-72b2d969a14d\") "
Oct 31 07:30:18.015368 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015306    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:30:18.015506 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015330    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:18.015506 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015355    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:18.015506 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.015474    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:18.017311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.017286    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:30:18.017403 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.017333    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "kube-api-access-5z8bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:30:18.017403 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.017357    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert" pod "b8607ba6-919e-47c5-901f-72b2d969a14d" (UID: "b8607ba6-919e-47c5-901f-72b2d969a14d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116388    5872 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-console-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116414    5872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8607ba6-919e-47c5-901f-72b2d969a14d-tmp\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116427    5872 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-oauth-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116440    5872 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116452    5872 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8607ba6-919e-47c5-901f-72b2d969a14d-service-ca\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116465    5872 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8607ba6-919e-47c5-901f-72b2d969a14d-console-oauth-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.116900 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.116478    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z8bc\" (UniqueName: \"kubernetes.io/projected/b8607ba6-919e-47c5-901f-72b2d969a14d-kube-api-access-5z8bc\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:18.123584 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.123556    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7mvb"
Oct 31 07:30:18.684061 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.684028    5872 generic.go:356] "Generic (PLEG): container finished" podID="b8607ba6-919e-47c5-901f-72b2d969a14d" containerID="f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121" exitCode=0
Oct 31 07:30:18.684468 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.684067    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccc758886-fc48j" event={"ID":"b8607ba6-919e-47c5-901f-72b2d969a14d","Type":"ContainerDied","Data":"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"}
Oct 31 07:30:18.684468 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.684086    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccc758886-fc48j"
Oct 31 07:30:18.684468 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.684108    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccc758886-fc48j" event={"ID":"b8607ba6-919e-47c5-901f-72b2d969a14d","Type":"ContainerDied","Data":"76f0c33b048f4b5a4903d3f9f3e97baf36df91393c068d6fa2a900fd176dab08"}
Oct 31 07:30:18.684468 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.684128    5872 scope.go:122] "RemoveContainer" containerID="f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"
Oct 31 07:30:18.692073 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.692056    5872 scope.go:122] "RemoveContainer" containerID="f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"
Oct 31 07:30:18.692328 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:30:18.692297    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121\": container with ID starting with f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121 not found: ID does not exist" containerID="f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"
Oct 31 07:30:18.692383 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.692327    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121"} err="failed to get container status \"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121\": rpc error: code = NotFound desc = could not find container \"f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121\": container with ID starting with f4a670b3f110deeb88e0cfb7e2975ea9a6a7dec624d013c1614a26cb58c2a121 not found: ID does not exist"
Oct 31 07:30:18.846104 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.846031    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:30:18.895726 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:18.895679    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ccc758886-fc48j"]
Oct 31 07:30:20.507253 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:20.507224    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8607ba6-919e-47c5-901f-72b2d969a14d" path="/var/lib/kubelet/pods/b8607ba6-919e-47c5-901f-72b2d969a14d/volumes"
Oct 31 07:30:20.873749 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:20.873672    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f6dr5"
Oct 31 07:30:30.798009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:30.797948    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-668bb4fc5d-sd6w7" podUID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" containerName="console" containerID="cri-o://62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3" gracePeriod=15
Oct 31 07:30:31.051779 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.051720    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:30:31.119203 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119174    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119213    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119244    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119266    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119311    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119330    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119359 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119352    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119382    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") pod \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\" (UID: \"812513cb-4f84-4af1-9f3e-9fa5c9fc673c\") "
Oct 31 07:30:31.119729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119591    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:30:31.119729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119609    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:31.119922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119825    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:31.120010 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119913    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:31.120010 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.119984    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:30:31.121651 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.121626    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:30:31.121930 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.121908    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:30:31.122020 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.121936    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh" pod "812513cb-4f84-4af1-9f3e-9fa5c9fc673c" (UID: "812513cb-4f84-4af1-9f3e-9fa5c9fc673c"). InnerVolumeSpecName "kube-api-access-5n6nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:30:31.220161 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220126    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n6nh\" (UniqueName: \"kubernetes.io/projected/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-kube-api-access-5n6nh\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220161 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220156    5872 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-service-ca\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220161 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220166    5872 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-oauth-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220177    5872 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220187    5872 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-console-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220196    5872 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-oauth-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220204    5872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-tmp\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.220388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.220213    5872 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812513cb-4f84-4af1-9f3e-9fa5c9fc673c-trusted-ca-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:30:31.732362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.732332    5872 generic.go:356] "Generic (PLEG): container finished" podID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" containerID="62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3" exitCode=0
Oct 31 07:30:31.732532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.732378    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bb4fc5d-sd6w7"
Oct 31 07:30:31.732532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.732424    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bb4fc5d-sd6w7" event={"ID":"812513cb-4f84-4af1-9f3e-9fa5c9fc673c","Type":"ContainerDied","Data":"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"}
Oct 31 07:30:31.732532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.732473    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bb4fc5d-sd6w7" event={"ID":"812513cb-4f84-4af1-9f3e-9fa5c9fc673c","Type":"ContainerDied","Data":"d3e74957c73f6878e37de731fbf6eaaedd5a69fe721e5b1a7e6e1f16e20126bd"}
Oct 31 07:30:31.732532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.732493    5872 scope.go:122] "RemoveContainer" containerID="62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"
Oct 31 07:30:31.741086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.741072    5872 scope.go:122] "RemoveContainer" containerID="62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"
Oct 31 07:30:31.741348 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:30:31.741331    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3\": container with ID starting with 62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3 not found: ID does not exist" containerID="62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"
Oct 31 07:30:31.741414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.741357    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3"} err="failed to get container status \"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3\": rpc error: code = NotFound desc = could not find container \"62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3\": container with ID starting with 62905d59820cc7ce06a7ed99f962485aa16bd7ec21759910059faa6e44335fd3 not found: ID does not exist"
Oct 31 07:30:31.894176 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.894131    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:30:31.897365 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:31.897344    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668bb4fc5d-sd6w7"]
Oct 31 07:30:32.507579 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:30:32.507544    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" path="/var/lib/kubelet/pods/812513cb-4f84-4af1-9f3e-9fa5c9fc673c/volumes"
Oct 31 07:30:40.527356 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:30:40.527308    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:31:05.474325 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474285    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474641    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="alertmanager" containerID="cri-o://aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb" gracePeriod=120
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474704    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="config-reloader" containerID="cri-o://4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17" gracePeriod=120
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474701    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-metric" containerID="cri-o://bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4" gracePeriod=120
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474769    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy" containerID="cri-o://f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd" gracePeriod=120
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474735    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="prom-label-proxy" containerID="cri-o://00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0" gracePeriod=120
Oct 31 07:31:05.474929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.474708    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-web" containerID="cri-o://569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34" gracePeriod=120
Oct 31 07:31:05.853883 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853798    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0" exitCode=0
Oct 31 07:31:05.853883 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853823    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd" exitCode=0
Oct 31 07:31:05.853883 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853831    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17" exitCode=0
Oct 31 07:31:05.853883 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853837    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb" exitCode=0
Oct 31 07:31:05.853883 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853872    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"}
Oct 31 07:31:05.854164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853958    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"}
Oct 31 07:31:05.854164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.853999    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"}
Oct 31 07:31:05.854164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:05.854024    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"}
Oct 31 07:31:06.713254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.713230    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:06.799313 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799224    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799313 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799271    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799313 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799309    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799598 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799360    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799598 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799387    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799598 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799564    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799763 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799614    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799763 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799648    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799763 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799661    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:06.799763 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799702    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.799763 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799733    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.800051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799765    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:06.800051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799779    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.800051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799817    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.800051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.799879    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") pod \"322020da-5e53-456f-89cb-96195b99f662\" (UID: \"322020da-5e53-456f-89cb-96195b99f662\") "
Oct 31 07:31:06.800258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.800148    5872 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-metrics-client-ca\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.800258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.800171    5872 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322020da-5e53-456f-89cb-96195b99f662-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.801026 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.800747    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:31:06.802737 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.802698    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "kube-api-access-8rhvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:31:06.803156 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803126    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.803471 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803404    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.803471 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803435    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:31:06.803642 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803571    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.803701 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803667    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.803759 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.803719    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.804163 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.804141    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:31:06.807523 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.807489    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.814000 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.813979    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config" pod "322020da-5e53-456f-89cb-96195b99f662" (UID: "322020da-5e53-456f-89cb-96195b99f662"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:06.861088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861060    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4" exitCode=0
Oct 31 07:31:06.861088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861083    5872 generic.go:356] "Generic (PLEG): container finished" podID="322020da-5e53-456f-89cb-96195b99f662" containerID="569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34" exitCode=0
Oct 31 07:31:06.861254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861142    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:06.861254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861140    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"}
Oct 31 07:31:06.861254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861214    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"}
Oct 31 07:31:06.861254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861244    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"322020da-5e53-456f-89cb-96195b99f662","Type":"ContainerDied","Data":"187785f40762a3616ca7b01c3326b4ace510a539696c168e982ff7791b8d2363"}
Oct 31 07:31:06.861371 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.861272    5872 scope.go:122] "RemoveContainer" containerID="00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"
Oct 31 07:31:06.869648 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.869632    5872 scope.go:122] "RemoveContainer" containerID="bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"
Oct 31 07:31:06.876396 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.876379    5872 scope.go:122] "RemoveContainer" containerID="f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"
Oct 31 07:31:06.882655 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.882639    5872 scope.go:122] "RemoveContainer" containerID="569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"
Oct 31 07:31:06.888745 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.888729    5872 scope.go:122] "RemoveContainer" containerID="4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"
Oct 31 07:31:06.895148 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.895134    5872 scope.go:122] "RemoveContainer" containerID="aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"
Oct 31 07:31:06.901274 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901253    5872 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-tls-assets\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901274 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901276    5872 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-config-volume\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901285    5872 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-web-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901296    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rhvq\" (UniqueName: \"kubernetes.io/projected/322020da-5e53-456f-89cb-96195b99f662-kube-api-access-8rhvq\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901308    5872 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901317    5872 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-main-tls\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901326    5872 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-alertmanager-main-db\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901335    5872 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901344    5872 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901354    5872 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/322020da-5e53-456f-89cb-96195b99f662-cluster-tls-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901391 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901362    5872 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/322020da-5e53-456f-89cb-96195b99f662-config-out\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:06.901837 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.901465    5872 scope.go:122] "RemoveContainer" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"
Oct 31 07:31:06.907887 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.907864    5872 scope.go:122] "RemoveContainer" containerID="00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"
Oct 31 07:31:06.908169 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.908152    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0\": container with ID starting with 00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0 not found: ID does not exist" containerID="00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"
Oct 31 07:31:06.908222 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908180    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"} err="failed to get container status \"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0\": rpc error: code = NotFound desc = could not find container \"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0\": container with ID starting with 00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0 not found: ID does not exist"
Oct 31 07:31:06.908222 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908201    5872 scope.go:122] "RemoveContainer" containerID="bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"
Oct 31 07:31:06.908456 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.908420    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4\": container with ID starting with bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4 not found: ID does not exist" containerID="bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"
Oct 31 07:31:06.908456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908442    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"} err="failed to get container status \"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4\": rpc error: code = NotFound desc = could not find container \"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4\": container with ID starting with bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4 not found: ID does not exist"
Oct 31 07:31:06.908456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908457    5872 scope.go:122] "RemoveContainer" containerID="f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"
Oct 31 07:31:06.908701 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.908686    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd\": container with ID starting with f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd not found: ID does not exist" containerID="f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"
Oct 31 07:31:06.908742 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908704    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"} err="failed to get container status \"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd\": rpc error: code = NotFound desc = could not find container \"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd\": container with ID starting with f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd not found: ID does not exist"
Oct 31 07:31:06.908742 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908716    5872 scope.go:122] "RemoveContainer" containerID="569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"
Oct 31 07:31:06.908928 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.908912    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34\": container with ID starting with 569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34 not found: ID does not exist" containerID="569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"
Oct 31 07:31:06.908991 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908931    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"} err="failed to get container status \"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34\": rpc error: code = NotFound desc = could not find container \"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34\": container with ID starting with 569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34 not found: ID does not exist"
Oct 31 07:31:06.908991 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.908943    5872 scope.go:122] "RemoveContainer" containerID="4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"
Oct 31 07:31:06.909219 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.909204    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17\": container with ID starting with 4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17 not found: ID does not exist" containerID="4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"
Oct 31 07:31:06.909268 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909222    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"} err="failed to get container status \"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17\": rpc error: code = NotFound desc = could not find container \"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17\": container with ID starting with 4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17 not found: ID does not exist"
Oct 31 07:31:06.909268 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909237    5872 scope.go:122] "RemoveContainer" containerID="aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"
Oct 31 07:31:06.909451 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.909434    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb\": container with ID starting with aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb not found: ID does not exist" containerID="aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"
Oct 31 07:31:06.909496 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909456    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"} err="failed to get container status \"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb\": rpc error: code = NotFound desc = could not find container \"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb\": container with ID starting with aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb not found: ID does not exist"
Oct 31 07:31:06.909496 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909474    5872 scope.go:122] "RemoveContainer" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"
Oct 31 07:31:06.909674 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:06.909660    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf\": container with ID starting with a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf not found: ID does not exist" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"
Oct 31 07:31:06.909711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909677    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"} err="failed to get container status \"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf\": rpc error: code = NotFound desc = could not find container \"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf\": container with ID starting with a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf not found: ID does not exist"
Oct 31 07:31:06.909711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909696    5872 scope.go:122] "RemoveContainer" containerID="00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"
Oct 31 07:31:06.909895 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909877    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0"} err="failed to get container status \"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0\": rpc error: code = NotFound desc = could not find container \"00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0\": container with ID starting with 00ec5a4a7bb0dc100dd08909685643692a33fba0d70e5362f72edd66f8565aa0 not found: ID does not exist"
Oct 31 07:31:06.909934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.909896    5872 scope.go:122] "RemoveContainer" containerID="bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"
Oct 31 07:31:06.910133 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910115    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4"} err="failed to get container status \"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4\": rpc error: code = NotFound desc = could not find container \"bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4\": container with ID starting with bbee2938d679f84d7a953cf85ce99553ec2087c9b57f68c5eae4c9ec5222e8a4 not found: ID does not exist"
Oct 31 07:31:06.910181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910135    5872 scope.go:122] "RemoveContainer" containerID="f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"
Oct 31 07:31:06.910374 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910358    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd"} err="failed to get container status \"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd\": rpc error: code = NotFound desc = could not find container \"f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd\": container with ID starting with f744b1dcbfdc9f59ac0d93190a557b2aeca66296e4d38f896eb56b2d7e4cd6bd not found: ID does not exist"
Oct 31 07:31:06.910425 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910374    5872 scope.go:122] "RemoveContainer" containerID="569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"
Oct 31 07:31:06.910566 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910550    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34"} err="failed to get container status \"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34\": rpc error: code = NotFound desc = could not find container \"569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34\": container with ID starting with 569e959c36e32a247e2da547b257a5c58b84e79621485058e10331863fbeab34 not found: ID does not exist"
Oct 31 07:31:06.910605 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910567    5872 scope.go:122] "RemoveContainer" containerID="4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"
Oct 31 07:31:06.910767 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910751    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17"} err="failed to get container status \"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17\": rpc error: code = NotFound desc = could not find container \"4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17\": container with ID starting with 4393de4c14a5c8c6e60707f115838a3ff22f5ab1626dccde4804069a451c0b17 not found: ID does not exist"
Oct 31 07:31:06.910767 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910766    5872 scope.go:122] "RemoveContainer" containerID="aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"
Oct 31 07:31:06.910950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910931    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb"} err="failed to get container status \"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb\": rpc error: code = NotFound desc = could not find container \"aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb\": container with ID starting with aa942ec233044ae410c27719713fa74a85f79c6b12c934ffd6a1d79252bc88bb not found: ID does not exist"
Oct 31 07:31:06.911078 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.910951    5872 scope.go:122] "RemoveContainer" containerID="a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"
Oct 31 07:31:06.911203 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:06.911184    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf"} err="failed to get container status \"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf\": rpc error: code = NotFound desc = could not find container \"a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf\": container with ID starting with a1d9908ef8cf1e91b66f9f2234ce51752af444231a154b870485452248fc1daf not found: ID does not exist"
Oct 31 07:31:07.043508 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.043471    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:07.046599 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.046574    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:07.069740 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069683    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:07.069944 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069932    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="prom-label-proxy"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069945    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="prom-label-proxy"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069955    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069960    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069983    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="init-config-reloader"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069988    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="init-config-reloader"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.069998    5872 cpu_manager.go:414] "containerMap: removing container" podUID="b8607ba6-919e-47c5-901f-72b2d969a14d" containerName="console"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070003    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8607ba6-919e-47c5-901f-72b2d969a14d" containerName="console"
Oct 31 07:31:07.070015 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070015    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="alertmanager"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070019    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="alertmanager"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070032    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-metric"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070037    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-metric"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070043    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="config-reloader"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070048    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="config-reloader"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070065    5872 cpu_manager.go:414] "containerMap: removing container" podUID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" containerName="console"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070071    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" containerName="console"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070084    5872 cpu_manager.go:414] "containerMap: removing container" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-web"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070090    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-web"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070131    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-metric"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070139    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="config-reloader"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070144    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="812513cb-4f84-4af1-9f3e-9fa5c9fc673c" containerName="console"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070151    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy-web"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070157    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="prom-label-proxy"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070161    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="kube-rbac-proxy"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070167    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="init-config-reloader"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070172    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8607ba6-919e-47c5-901f-72b2d969a14d" containerName="console"
Oct 31 07:31:07.070240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.070178    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="322020da-5e53-456f-89cb-96195b99f662" containerName="alertmanager"
Oct 31 07:31:07.073378 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.073361    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127487    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127527    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127487    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127558    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127576    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 07:31:07.127607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127593    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 07:31:07.127957 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127630    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cs9d6\""
Oct 31 07:31:07.127957 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127645    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 07:31:07.127957 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.127655    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 07:31:07.128164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.128150    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 07:31:07.177755 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.177728    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:07.203726 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203693    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.203868 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203733    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-config-out\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.203868 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203752    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.203868 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203772    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-web-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204045 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203878    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204045 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.203926    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204045 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204024    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204156 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204065    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204156 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204133    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204160    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204191    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204347 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204244    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.204347 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.204280    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb59t\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-kube-api-access-nb59t\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305053    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305086    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305117    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305143    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305168    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb59t\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-kube-api-access-nb59t\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305205    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305237    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-config-out\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305266    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305290    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-web-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305311    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305806 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305332    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305806 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305359    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.305806 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.305395    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.306336 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.306092    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.306336 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.306193    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.307094 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.307068    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951ec597-58ce-4137-ab0d-a749323ad7f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308054    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951ec597-58ce-4137-ab0d-a749323ad7f9-config-out\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308189 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308166    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308543 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308518    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308685 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308659    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308767 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308747    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.308802 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.308765    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.309048 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.309030    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.309346 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.309324    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.309995 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.309959    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951ec597-58ce-4137-ab0d-a749323ad7f9-web-config\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.361548 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.361490    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb59t\" (UniqueName: \"kubernetes.io/projected/951ec597-58ce-4137-ab0d-a749323ad7f9-kube-api-access-nb59t\") pod \"alertmanager-main-0\" (UID: \"951ec597-58ce-4137-ab0d-a749323ad7f9\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.389245 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.389224    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 07:31:07.809601 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.809569    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 07:31:07.814315 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:31:07.814287    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951ec597_58ce_4137_ab0d_a749323ad7f9.slice/crio-fa65bdca5cbc861172d28d23b8c736a44ebef8167509af484a04cd8051bb7236 WatchSource:0}: Error finding container fa65bdca5cbc861172d28d23b8c736a44ebef8167509af484a04cd8051bb7236: Status 404 returned error can't find the container with id fa65bdca5cbc861172d28d23b8c736a44ebef8167509af484a04cd8051bb7236
Oct 31 07:31:07.867183 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:07.867158    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"fa65bdca5cbc861172d28d23b8c736a44ebef8167509af484a04cd8051bb7236"}
Oct 31 07:31:08.511087 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:08.511052    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="322020da-5e53-456f-89cb-96195b99f662" path="/var/lib/kubelet/pods/322020da-5e53-456f-89cb-96195b99f662/volumes"
Oct 31 07:31:08.872187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:08.872111    5872 generic.go:356] "Generic (PLEG): container finished" podID="951ec597-58ce-4137-ab0d-a749323ad7f9" containerID="a94d58253f63414fc0ee6e6d3338c56772ef863b6a5c73eb004e02c1e7659978" exitCode=0
Oct 31 07:31:08.872539 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:08.872186    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerDied","Data":"a94d58253f63414fc0ee6e6d3338c56772ef863b6a5c73eb004e02c1e7659978"}
Oct 31 07:31:09.879806 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879774    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"8fe6b1b7a91b99b0098cb3eb71b696d3e6eb77d2ab7ad7f2815184fc293da16f"}
Oct 31 07:31:09.880177 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879845    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"26df48bacbcba36a29411451dab521bf87d200ef47e0e005287bd80d0c7f1294"}
Oct 31 07:31:09.880177 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879873    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"8e30968da591b45ed94d1dee5b4d12741112e95352a73fdf630ea96000ce845d"}
Oct 31 07:31:09.880177 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879898    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"2a447b74081671f79e808af7f3cd945fd160bb6d81def1e9893e81f34ca3fea1"}
Oct 31 07:31:09.880177 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879925    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"47a7c834ffcb5b11d19cc19168f4c816b0361e8210f740de3967ea0fef99c06b"}
Oct 31 07:31:09.880177 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:09.879948    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951ec597-58ce-4137-ab0d-a749323ad7f9","Type":"ContainerStarted","Data":"8f8c8d9a2d089616d51725342ecb548ff483634338fe9e7bcb31e49e2178a38e"}
Oct 31 07:31:10.000417 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:10.000367    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.987833005 podStartE2EDuration="3.000352796s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.519791ms" isStatefulPod=false podCreationTimestamp="2026-10-31 07:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:31:09.999352762 +0000 UTC m=+79.611562504" watchObservedRunningTime="2026-10-31 07:31:10.000352796 +0000 UTC m=+79.612562538"
Oct 31 07:31:10.527174 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:10.527138    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:31:13.134704 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:13.134644    5872 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal" podUID="9d8d2bd7442930f2267d92c4a39b2cf9" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:31:19.955117 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:19.955081    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6847cf966f-x5xz9"]
Oct 31 07:31:19.957310 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:19.957293    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.016363 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.016332    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6847cf966f-x5xz9"]
Oct 31 07:31:20.123867 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.123836    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f997fea-d60a-4922-9107-a6074fcb10b7-tmp\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124072 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.123881    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-console-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124072 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.123900    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-service-ca\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124072 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.123989    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-oauth-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.124107    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.124136    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-oauth-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.124161    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-trusted-ca-bundle\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.124273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.124189    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5n4g\" (UniqueName: \"kubernetes.io/projected/4f997fea-d60a-4922-9107-a6074fcb10b7-kube-api-access-k5n4g\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225644 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225563    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f997fea-d60a-4922-9107-a6074fcb10b7-tmp\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225644 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225613    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-console-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225644 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225631    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-service-ca\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225893 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225653    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-oauth-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225893 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225688    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225893 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225710    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-oauth-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.225893 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225848    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-trusted-ca-bundle\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.226115 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.225897    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5n4g\" (UniqueName: \"kubernetes.io/projected/4f997fea-d60a-4922-9107-a6074fcb10b7-kube-api-access-k5n4g\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.226288 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.226228    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f997fea-d60a-4922-9107-a6074fcb10b7-tmp\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.226475 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.226445    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-console-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.226561 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.226487    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-service-ca\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.226561 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.226487    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-oauth-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.227026 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.227007    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f997fea-d60a-4922-9107-a6074fcb10b7-trusted-ca-bundle\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.228680 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.228660    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-oauth-config\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.228779 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.228764    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f997fea-d60a-4922-9107-a6074fcb10b7-console-serving-cert\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.282460 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.282429    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5n4g\" (UniqueName: \"kubernetes.io/projected/4f997fea-d60a-4922-9107-a6074fcb10b7-kube-api-access-k5n4g\") pod \"console-6847cf966f-x5xz9\" (UID: \"4f997fea-d60a-4922-9107-a6074fcb10b7\") " pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.567729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.567646    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:20.936176 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:20.936145    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6847cf966f-x5xz9"]
Oct 31 07:31:20.939456 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:31:20.939424    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f997fea_d60a_4922_9107_a6074fcb10b7.slice/crio-8fbe29af67a2ba9f175a7b68fe2904b52a2925bab40e10d0108b07a7a6c100be WatchSource:0}: Error finding container 8fbe29af67a2ba9f175a7b68fe2904b52a2925bab40e10d0108b07a7a6c100be: Status 404 returned error can't find the container with id 8fbe29af67a2ba9f175a7b68fe2904b52a2925bab40e10d0108b07a7a6c100be
Oct 31 07:31:21.928811 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:21.928775    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6847cf966f-x5xz9" event={"ID":"4f997fea-d60a-4922-9107-a6074fcb10b7","Type":"ContainerStarted","Data":"c526c8522c39ffe79f58eb9d39a2634fc76a92254e833470b6418b2676fba680"}
Oct 31 07:31:21.929322 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:21.928830    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6847cf966f-x5xz9" event={"ID":"4f997fea-d60a-4922-9107-a6074fcb10b7","Type":"ContainerStarted","Data":"8fbe29af67a2ba9f175a7b68fe2904b52a2925bab40e10d0108b07a7a6c100be"}
Oct 31 07:31:22.045692 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:22.045562    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6847cf966f-x5xz9" podStartSLOduration=3.045545248 podStartE2EDuration="3.045545248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:31:22.044874339 +0000 UTC m=+91.657084081" watchObservedRunningTime="2026-10-31 07:31:22.045545248 +0000 UTC m=+91.657754988"
Oct 31 07:31:30.568752 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:30.568677    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:30.569147 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:30.568785    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:30.573381 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:30.573362    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:30.965265 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:30.965237    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6847cf966f-x5xz9"
Oct 31 07:31:31.130067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:31.130031    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:31:40.527058 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:40.527021    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:31:56.150433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.150371    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5484f5bdb4-2wwtm" podUID="39576cb3-303d-4207-8b58-9500f7b0a6c0" containerName="console" containerID="cri-o://0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f" gracePeriod=15
Oct 31 07:31:56.383360 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.383339    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:31:56.535229 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535199    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535254    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535297    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535320    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535348    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535371    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535619 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535411    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\" (UniqueName: \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535619 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535451    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\") pod \"39576cb3-303d-4207-8b58-9500f7b0a6c0\" (UID: \"39576cb3-303d-4207-8b58-9500f7b0a6c0\") "
Oct 31 07:31:56.535909 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535720    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:31:56.535909 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535782    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:56.535909 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535782    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:56.536139 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.535909    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:56.536139 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.536055    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:31:56.537655 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.537625    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:56.537744 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.537653    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:31:56.537744 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.537679    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2" pod "39576cb3-303d-4207-8b58-9500f7b0a6c0" (UID: "39576cb3-303d-4207-8b58-9500f7b0a6c0"). InnerVolumeSpecName "kube-api-access-84kb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:31:56.636158 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636121    5872 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-service-ca\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636158 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636153    5872 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-oauth-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636158 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636162    5872 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636172    5872 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39576cb3-303d-4207-8b58-9500f7b0a6c0-trusted-ca-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636182    5872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39576cb3-303d-4207-8b58-9500f7b0a6c0-tmp\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636191    5872 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-serving-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636200    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84kb2\" (UniqueName: \"kubernetes.io/projected/39576cb3-303d-4207-8b58-9500f7b0a6c0-kube-api-access-84kb2\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:56.636390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:56.636209    5872 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39576cb3-303d-4207-8b58-9500f7b0a6c0-console-oauth-config\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:31:57.059438 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.059399    5872 generic.go:356] "Generic (PLEG): container finished" podID="39576cb3-303d-4207-8b58-9500f7b0a6c0" containerID="0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f" exitCode=0
Oct 31 07:31:57.059613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.059480    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5484f5bdb4-2wwtm"
Oct 31 07:31:57.059613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.059490    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5484f5bdb4-2wwtm" event={"ID":"39576cb3-303d-4207-8b58-9500f7b0a6c0","Type":"ContainerDied","Data":"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"}
Oct 31 07:31:57.059613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.059581    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5484f5bdb4-2wwtm" event={"ID":"39576cb3-303d-4207-8b58-9500f7b0a6c0","Type":"ContainerDied","Data":"d58947cc45a1a363ffd4026d355f7da5184a298a0069bc686a4972b96602a027"}
Oct 31 07:31:57.059613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.059608    5872 scope.go:122] "RemoveContainer" containerID="0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"
Oct 31 07:31:57.068450 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.068428    5872 scope.go:122] "RemoveContainer" containerID="0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"
Oct 31 07:31:57.068706 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:31:57.068687    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f\": container with ID starting with 0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f not found: ID does not exist" containerID="0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"
Oct 31 07:31:57.068747 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.068716    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f"} err="failed to get container status \"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f\": rpc error: code = NotFound desc = could not find container \"0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f\": container with ID starting with 0fd2a5c0a35588d7bd4f83f4b918da3d64281eb8895cc0dc6535369afc96298f not found: ID does not exist"
Oct 31 07:31:57.222257 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.222223    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:31:57.271753 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:57.271722    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5484f5bdb4-2wwtm"]
Oct 31 07:31:58.506773 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:31:58.506742    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39576cb3-303d-4207-8b58-9500f7b0a6c0" path="/var/lib/kubelet/pods/39576cb3-303d-4207-8b58-9500f7b0a6c0/volumes"
Oct 31 07:32:10.527333 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:32:10.527296    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:32:40.526916 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:32:40.526871    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:33:10.527869 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:33:10.527789    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:33:40.527305 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:33:40.527264    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:33:52.206422 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.206384    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"]
Oct 31 07:33:52.206803 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.206685    5872 cpu_manager.go:414] "containerMap: removing container" podUID="39576cb3-303d-4207-8b58-9500f7b0a6c0" containerName="console"
Oct 31 07:33:52.206803 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.206695    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39576cb3-303d-4207-8b58-9500f7b0a6c0" containerName="console"
Oct 31 07:33:52.206803 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.206762    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="39576cb3-303d-4207-8b58-9500f7b0a6c0" containerName="console"
Oct 31 07:33:52.209660 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.209643    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.255336 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.255302    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.255483 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.255360    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.255483 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.255457    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jlf\" (UniqueName: \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.265284 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.265262    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-w52lj\""
Oct 31 07:33:52.315247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.315210    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:33:52.315432 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.315255    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:33:52.316051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.316031    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"]
Oct 31 07:33:52.356190 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.356164    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.356319 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.356228    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.356319 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.356275    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jlf\" (UniqueName: \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.356638 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.356613    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.356638 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.356630    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.413882 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.413851    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jlf\" (UniqueName: \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.525417 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.525345    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:33:52.890483 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.890360    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"]
Oct 31 07:33:52.894097 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:33:52.894061    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fad2c2f_f61a_49bd_8dc4_5d6bd6b10765.slice/crio-212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96 WatchSource:0}: Error finding container 212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96: Status 404 returned error can't find the container with id 212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96
Oct 31 07:33:52.896163 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:52.896142    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:33:53.461372 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:53.461337    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerStarted","Data":"212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96"}
Oct 31 07:33:59.486769 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:59.486733    5872 generic.go:356] "Generic (PLEG): container finished" podID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerID="62bfaa58710753c4ebeff7835a924869450ca114a19b97304acc55b9611fed75" exitCode=0
Oct 31 07:33:59.487185 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:33:59.486797    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerDied","Data":"62bfaa58710753c4ebeff7835a924869450ca114a19b97304acc55b9611fed75"}
Oct 31 07:34:03.505941 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:03.505898    5872 generic.go:356] "Generic (PLEG): container finished" podID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerID="ba054ee1c0385af067eb21d1c69962d27489caad2623532266f2714b08e7c975" exitCode=0
Oct 31 07:34:03.506443 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:03.505956    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerDied","Data":"ba054ee1c0385af067eb21d1c69962d27489caad2623532266f2714b08e7c975"}
Oct 31 07:34:10.526985 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:10.526936    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:34:10.533844 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:10.533814    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerStarted","Data":"e20074d58fc52e2331c365611615353de77f171a17f50d40e48189d653db1951"}
Oct 31 07:34:11.539333 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:11.539304    5872 generic.go:356] "Generic (PLEG): container finished" podID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerID="e20074d58fc52e2331c365611615353de77f171a17f50d40e48189d653db1951" exitCode=0
Oct 31 07:34:11.539711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:11.539353    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerDied","Data":"e20074d58fc52e2331c365611615353de77f171a17f50d40e48189d653db1951"}
Oct 31 07:34:12.667218 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.667190    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:34:12.833700 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.833616    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\") pod \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") "
Oct 31 07:34:12.833867 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.833701    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\" (UniqueName: \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\") pod \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") "
Oct 31 07:34:12.833867 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.833740    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\") pod \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\" (UID: \"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765\") "
Oct 31 07:34:12.834414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.834385    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle" pod "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" (UID: "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:34:12.835910 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.835886    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf" pod "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" (UID: "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765"). InnerVolumeSpecName "kube-api-access-76jlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:34:12.838847 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.838824    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util" pod "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" (UID: "5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:34:12.935186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.935151    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:34:12.935186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.935181    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76jlf\" (UniqueName: \"kubernetes.io/projected/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-kube-api-access-76jlf\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:34:12.935186 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:12.935194    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:34:13.548000 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:13.547955    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z"
Oct 31 07:34:13.548000 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:13.547950    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cz5r6z" event={"ID":"5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765","Type":"ContainerDied","Data":"212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96"}
Oct 31 07:34:13.548203 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:13.548022    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="212731a5506546007d04b7cd0f87e2864ba8f242671ad30b15c58d00a351cb96"
Oct 31 07:34:20.074135 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074100    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"]
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074391    5872 cpu_manager.go:414] "containerMap: removing container" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="util"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074402    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="util"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074421    5872 cpu_manager.go:414] "containerMap: removing container" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="pull"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074426    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="pull"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074446    5872 cpu_manager.go:414] "containerMap: removing container" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="extract"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074451    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="extract"
Oct 31 07:34:20.074515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.074510    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fad2c2f-f61a-49bd-8dc4-5d6bd6b10765" containerName="extract"
Oct 31 07:34:20.078222 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.078204    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.132251 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.132204    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Oct 31 07:34:20.132251 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.132204    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Oct 31 07:34:20.181811 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.181768    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2jx5c\""
Oct 31 07:34:20.182017 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.181842    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Oct 31 07:34:20.183357 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.183334    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"]
Oct 31 07:34:20.194621 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.194596    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3acb21a7-a099-4995-b032-10913dcede9e-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.194749 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.194669    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmqm\" (UniqueName: \"kubernetes.io/projected/3acb21a7-a099-4995-b032-10913dcede9e-kube-api-access-lqmqm\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.295390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.295352    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmqm\" (UniqueName: \"kubernetes.io/projected/3acb21a7-a099-4995-b032-10913dcede9e-kube-api-access-lqmqm\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.295390 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.295395    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3acb21a7-a099-4995-b032-10913dcede9e-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.297691 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.297671    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3acb21a7-a099-4995-b032-10913dcede9e-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.354134 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.354063    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmqm\" (UniqueName: \"kubernetes.io/projected/3acb21a7-a099-4995-b032-10913dcede9e-kube-api-access-lqmqm\") pod \"custom-metrics-autoscaler-operator-c667576c8-cfsx4\" (UID: \"3acb21a7-a099-4995-b032-10913dcede9e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.391780 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.391740    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:20.813185 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:20.813159    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"]
Oct 31 07:34:20.814630 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:34:20.814592    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acb21a7_a099_4995_b032_10913dcede9e.slice/crio-1bc94e819e824741e78544bb10331e6e394f6dd0397cf75a94b8f3e27321dfcf WatchSource:0}: Error finding container 1bc94e819e824741e78544bb10331e6e394f6dd0397cf75a94b8f3e27321dfcf: Status 404 returned error can't find the container with id 1bc94e819e824741e78544bb10331e6e394f6dd0397cf75a94b8f3e27321dfcf
Oct 31 07:34:21.575602 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:21.575557    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4" event={"ID":"3acb21a7-a099-4995-b032-10913dcede9e","Type":"ContainerStarted","Data":"1bc94e819e824741e78544bb10331e6e394f6dd0397cf75a94b8f3e27321dfcf"}
Oct 31 07:34:25.594098 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:25.594032    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4" event={"ID":"3acb21a7-a099-4995-b032-10913dcede9e","Type":"ContainerStarted","Data":"f09cfb774d6c78a0625872428d27d9039ac64ccb49e7bf3305ef9a766849f33f"}
Oct 31 07:34:25.594690 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:25.594142    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:25.809948 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:25.809898    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4" podStartSLOduration=2.002782273 podStartE2EDuration="5.809885909s" totalImagesPullingTime="3.807103636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:25.759846243 +0000 UTC m=+275.372055985" watchObservedRunningTime="2026-10-31 07:34:25.809885909 +0000 UTC m=+275.422095650"
Oct 31 07:34:27.746581 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.746543    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-c9rhr"]
Oct 31 07:34:27.748733 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.748705    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.801201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.801173    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Oct 31 07:34:27.801201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.801173    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-jbq8g\""
Oct 31 07:34:27.801389 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.801174    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Oct 31 07:34:27.807819 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.807793    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-c9rhr"]
Oct 31 07:34:27.848867 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.848827    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkzsp\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-kube-api-access-xkzsp\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.848867 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.848869    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.849133 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.849018    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.949654 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.949616    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.949821 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.949667    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkzsp\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-kube-api-access-xkzsp\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.949821 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:27.949692    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:27.949821 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949790    5872 configmap.go:193] Couldn't get configMap openshift-keda/keda-ocp-cabundle: configmap "keda-ocp-cabundle" not found
Oct 31 07:34:27.949921 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949896    5872 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0 podName:8e6f74bb-fe7c-40d1-924e-65f1909bd43c nodeName:}" failed. No retries permitted until 2026-10-31 07:34:28.449873998 +0000 UTC m=+278.062083746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cabundle0" (UniqueName: "kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0") pod "keda-operator-7dc85965f-c9rhr" (UID: "8e6f74bb-fe7c-40d1-924e-65f1909bd43c") : configmap "keda-ocp-cabundle" not found
Oct 31 07:34:27.949921 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949898    5872 secret.go:281] references non-existent secret key: ca.crt
Oct 31 07:34:27.949921 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949917    5872 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Oct 31 07:34:27.950041 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949926    5872 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-c9rhr: references non-existent secret key: ca.crt
Oct 31 07:34:27.950041 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:27.949988    5872 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates podName:8e6f74bb-fe7c-40d1-924e-65f1909bd43c nodeName:}" failed. No retries permitted until 2026-10-31 07:34:28.449956047 +0000 UTC m=+278.062165781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates") pod "keda-operator-7dc85965f-c9rhr" (UID: "8e6f74bb-fe7c-40d1-924e-65f1909bd43c") : references non-existent secret key: ca.crt
Oct 31 07:34:28.009898 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:28.009822    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkzsp\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-kube-api-access-xkzsp\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:28.455217 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:28.455185    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:28.455399 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:28.455234    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:28.455399 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:28.455332    5872 secret.go:281] references non-existent secret key: ca.crt
Oct 31 07:34:28.455399 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:28.455344    5872 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Oct 31 07:34:28.455399 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:28.455352    5872 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-c9rhr: references non-existent secret key: ca.crt
Oct 31 07:34:28.455540 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:28.455404    5872 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates podName:8e6f74bb-fe7c-40d1-924e-65f1909bd43c nodeName:}" failed. No retries permitted until 2026-10-31 07:34:29.455388541 +0000 UTC m=+279.067598264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates") pod "keda-operator-7dc85965f-c9rhr" (UID: "8e6f74bb-fe7c-40d1-924e-65f1909bd43c") : references non-existent secret key: ca.crt
Oct 31 07:34:28.456016 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:28.455993    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-cabundle0\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:29.358069 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.358030    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"]
Oct 31 07:34:29.360239 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.360222    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.412339 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.412315    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Oct 31 07:34:29.418388 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.418346    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"]
Oct 31 07:34:29.465124 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.465092    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:29.465298 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.465127    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b781ec74-1ce8-4380-8e32-2e53431bc9c5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.465298 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.465149    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29q5d\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-kube-api-access-29q5d\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.465298 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.465263    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.467439 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.467418    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e6f74bb-fe7c-40d1-924e-65f1909bd43c-certificates\") pod \"keda-operator-7dc85965f-c9rhr\" (UID: \"8e6f74bb-fe7c-40d1-924e-65f1909bd43c\") " pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:29.560273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.560239    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:29.566434 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.566407    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b781ec74-1ce8-4380-8e32-2e53431bc9c5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.566557 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.566442    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29q5d\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-kube-api-access-29q5d\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.566669 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.566641    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.566816 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.566796    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b781ec74-1ce8-4380-8e32-2e53431bc9c5-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.569421 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.569401    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.627101 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.627074    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29q5d\" (UniqueName: \"kubernetes.io/projected/b781ec74-1ce8-4380-8e32-2e53431bc9c5-kube-api-access-29q5d\") pod \"keda-metrics-apiserver-86bd856cfb-rx7j6\" (UID: \"b781ec74-1ce8-4380-8e32-2e53431bc9c5\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.671214 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.671181    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:29.850005 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.849961    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-srhkd"]
Oct 31 07:34:29.852295 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.852280    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:29.870324 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.870268    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gkc\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-kube-api-access-b7gkc\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:29.870324 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.870304    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:29.905012 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.904958    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Oct 31 07:34:29.913532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.913497    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-srhkd"]
Oct 31 07:34:29.962329 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.962298    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-c9rhr"]
Oct 31 07:34:29.966811 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:34:29.966097    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6f74bb_fe7c_40d1_924e_65f1909bd43c.slice/crio-cdec4ea304bfe64fbcd579ac6698c30ce77ad7b7301ab1c19f120047bece9cbe WatchSource:0}: Error finding container cdec4ea304bfe64fbcd579ac6698c30ce77ad7b7301ab1c19f120047bece9cbe: Status 404 returned error can't find the container with id cdec4ea304bfe64fbcd579ac6698c30ce77ad7b7301ab1c19f120047bece9cbe
Oct 31 07:34:29.971554 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.971532    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:29.971647 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:29.971636    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gkc\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-kube-api-access-b7gkc\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:29.971711 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:29.971693    5872 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Oct 31 07:34:29.971756 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:29.971720    5872 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-7b7c985c58-srhkd: secret "keda-admission-webhooks-certs" not found
Oct 31 07:34:29.971797 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:29.971790    5872 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates podName:bf044f85-03ec-4157-9fb7-34b37a55236a nodeName:}" failed. No retries permitted until 2026-10-31 07:34:30.471769637 +0000 UTC m=+280.083979361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates") pod "keda-admission-7b7c985c58-srhkd" (UID: "bf044f85-03ec-4157-9fb7-34b37a55236a") : secret "keda-admission-webhooks-certs" not found
Oct 31 07:34:30.027686 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.027659    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gkc\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-kube-api-access-b7gkc\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:30.063627 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.063592    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"]
Oct 31 07:34:30.067415 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:34:30.067384    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb781ec74_1ce8_4380_8e32_2e53431bc9c5.slice/crio-6e4d803a22731d1c7ad10a92ca7825315b20d023d68a015307beae08f395e661 WatchSource:0}: Error finding container 6e4d803a22731d1c7ad10a92ca7825315b20d023d68a015307beae08f395e661: Status 404 returned error can't find the container with id 6e4d803a22731d1c7ad10a92ca7825315b20d023d68a015307beae08f395e661
Oct 31 07:34:30.475822 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.475793    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:30.478227 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.478200    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bf044f85-03ec-4157-9fb7-34b37a55236a-certificates\") pod \"keda-admission-7b7c985c58-srhkd\" (UID: \"bf044f85-03ec-4157-9fb7-34b37a55236a\") " pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:30.616721 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.616685    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6" event={"ID":"b781ec74-1ce8-4380-8e32-2e53431bc9c5","Type":"ContainerStarted","Data":"6e4d803a22731d1c7ad10a92ca7825315b20d023d68a015307beae08f395e661"}
Oct 31 07:34:30.617722 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.617688    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-c9rhr" event={"ID":"8e6f74bb-fe7c-40d1-924e-65f1909bd43c","Type":"ContainerStarted","Data":"cdec4ea304bfe64fbcd579ac6698c30ce77ad7b7301ab1c19f120047bece9cbe"}
Oct 31 07:34:30.763917 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:30.763841    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:31.135615 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:31.135525    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-srhkd"]
Oct 31 07:34:31.139327 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:34:31.139300    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf044f85_03ec_4157_9fb7_34b37a55236a.slice/crio-b391b232dee6e23e0672cfc9f32e206a529f40eb4fea5f5f5143651ccc175a0a WatchSource:0}: Error finding container b391b232dee6e23e0672cfc9f32e206a529f40eb4fea5f5f5143651ccc175a0a: Status 404 returned error can't find the container with id b391b232dee6e23e0672cfc9f32e206a529f40eb4fea5f5f5143651ccc175a0a
Oct 31 07:34:31.623218 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:31.623182    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-srhkd" event={"ID":"bf044f85-03ec-4157-9fb7-34b37a55236a","Type":"ContainerStarted","Data":"b391b232dee6e23e0672cfc9f32e206a529f40eb4fea5f5f5143651ccc175a0a"}
Oct 31 07:34:34.641257 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.641219    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6" event={"ID":"b781ec74-1ce8-4380-8e32-2e53431bc9c5","Type":"ContainerStarted","Data":"d2a35070e3a55cb7ee518c4474cfd3601373a45a4873c2500f9340c14b352cb2"}
Oct 31 07:34:34.642011 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.641986    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:34.643096 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.643067    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-srhkd" event={"ID":"bf044f85-03ec-4157-9fb7-34b37a55236a","Type":"ContainerStarted","Data":"979a49a9ccecda812da1326e3624c14652025933973e5a8253bfbfc69bedec6a"}
Oct 31 07:34:34.643332 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.643309    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:34.756076 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.756017    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6" podStartSLOduration=1.771708984 podStartE2EDuration="5.756000412s" totalImagesPullingTime="3.984291428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:34.75536952 +0000 UTC m=+284.367579263" watchObservedRunningTime="2026-10-31 07:34:34.756000412 +0000 UTC m=+284.368210151"
Oct 31 07:34:34.868769 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:34.868706    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-admission-7b7c985c58-srhkd" podStartSLOduration=3.221974438 podStartE2EDuration="5.868687727s" totalImagesPullingTime="2.646713289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:34.868142589 +0000 UTC m=+284.480352345" watchObservedRunningTime="2026-10-31 07:34:34.868687727 +0000 UTC m=+284.480897472"
Oct 31 07:34:35.648833 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:35.648787    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-c9rhr" event={"ID":"8e6f74bb-fe7c-40d1-924e-65f1909bd43c","Type":"ContainerStarted","Data":"9ad46e38f4b7e57e5be9a5e1db30f44dfd615e7f3f067a62d123b24637e920a4"}
Oct 31 07:34:35.649296 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:35.648866    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:34:35.774201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:35.774146    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-c9rhr" podStartSLOduration=4.02610192 podStartE2EDuration="8.774130075s" totalImagesPullingTime="4.748028155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:35.772136704 +0000 UTC m=+285.384346446" watchObservedRunningTime="2026-10-31 07:34:35.774130075 +0000 UTC m=+285.386339875"
Oct 31 07:34:40.529739 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:34:40.529700    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:34:46.600316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:46.600285    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-cfsx4"
Oct 31 07:34:46.658192 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:46.658157    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-rx7j6"
Oct 31 07:34:50.555834 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:50.555806    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:34:50.556548 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:50.556525    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:34:55.651743 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:55.651712    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-7b7c985c58-srhkd"
Oct 31 07:34:56.656023 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:34:56.655939    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-c9rhr"
Oct 31 07:35:10.528454 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:35:10.528412    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:35:19.731872 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.731840    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"]
Oct 31 07:35:19.737065 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.737046    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.796834 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.796802    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxzg6\" (UniqueName: \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.797020 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.796850    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.797091 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.797013    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.841410 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.841385    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:35:19.841562 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.841420    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:35:19.841562 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.841454    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-bmjtd\""
Oct 31 07:35:19.842394 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.842373    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"]
Oct 31 07:35:19.897524 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.897495    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxzg6\" (UniqueName: \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.897662 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.897553    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.897662 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.897609    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.897948 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.897929    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.898057 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.898008    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:19.954291 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:19.954260    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxzg6\" (UniqueName: \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:20.049397 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:20.049312    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:20.418664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:20.418632    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"]
Oct 31 07:35:20.422291 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:35:20.422263    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3428f00_5b59_4790_814d_1c791349ffbf.slice/crio-f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519 WatchSource:0}: Error finding container f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519: Status 404 returned error can't find the container with id f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519
Oct 31 07:35:20.844614 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:20.844531    5872 generic.go:356] "Generic (PLEG): container finished" podID="c3428f00-5b59-4790-814d-1c791349ffbf" containerID="5d6f1e3d1444988406808aa430a2dd48777f282621a5d86a6d54cef66a006830" exitCode=0
Oct 31 07:35:20.844614 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:20.844580    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerDied","Data":"5d6f1e3d1444988406808aa430a2dd48777f282621a5d86a6d54cef66a006830"}
Oct 31 07:35:20.845029 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:20.844637    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerStarted","Data":"f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519"}
Oct 31 07:35:23.858459 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:23.858393    5872 generic.go:356] "Generic (PLEG): container finished" podID="c3428f00-5b59-4790-814d-1c791349ffbf" containerID="db664a3c4b5d59f3d6b4db43b26ae372d094b33c6f48666a5fab128536773f92" exitCode=0
Oct 31 07:35:23.858785 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:23.858484    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerDied","Data":"db664a3c4b5d59f3d6b4db43b26ae372d094b33c6f48666a5fab128536773f92"}
Oct 31 07:35:24.864569 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:24.864537    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerStarted","Data":"1c079476ac9ffc9559664732ddc4123d7c1c13783405cefb8f4fc8c61658b1ba"}
Oct 31 07:35:24.979673 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:24.979627    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" podStartSLOduration=3.244035549 podStartE2EDuration="5.979606902s" totalImagesPullingTime="2.735571353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:24.978608664 +0000 UTC m=+334.590818405" watchObservedRunningTime="2026-10-31 07:35:24.979606902 +0000 UTC m=+334.591816641"
Oct 31 07:35:34.911075 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:34.911048    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:35:34.911740 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:34.911719    5872 generic.go:356] "Generic (PLEG): container finished" podID="c3428f00-5b59-4790-814d-1c791349ffbf" containerID="1c079476ac9ffc9559664732ddc4123d7c1c13783405cefb8f4fc8c61658b1ba" exitCode=1
Oct 31 07:35:34.911815 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:34.911789    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerDied","Data":"1c079476ac9ffc9559664732ddc4123d7c1c13783405cefb8f4fc8c61658b1ba"}
Oct 31 07:35:36.032103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.032080    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:35:36.035307 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.035292    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:36.127102 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.127073    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\") pod \"c3428f00-5b59-4790-814d-1c791349ffbf\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") "
Oct 31 07:35:36.127240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.127146    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\" (UniqueName: \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\") pod \"c3428f00-5b59-4790-814d-1c791349ffbf\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") "
Oct 31 07:35:36.127240 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.127211    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\") pod \"c3428f00-5b59-4790-814d-1c791349ffbf\" (UID: \"c3428f00-5b59-4790-814d-1c791349ffbf\") "
Oct 31 07:35:36.127790 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.127767    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle" pod "c3428f00-5b59-4790-814d-1c791349ffbf" (UID: "c3428f00-5b59-4790-814d-1c791349ffbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:35:36.129230 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.129199    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6" pod "c3428f00-5b59-4790-814d-1c791349ffbf" (UID: "c3428f00-5b59-4790-814d-1c791349ffbf"). InnerVolumeSpecName "kube-api-access-wxzg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:35:36.131676 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.131654    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util" pod "c3428f00-5b59-4790-814d-1c791349ffbf" (UID: "c3428f00-5b59-4790-814d-1c791349ffbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:35:36.228004 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.227905    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxzg6\" (UniqueName: \"kubernetes.io/projected/c3428f00-5b59-4790-814d-1c791349ffbf-kube-api-access-wxzg6\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:36.228004 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.227936    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:36.228004 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.227949    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3428f00-5b59-4790-814d-1c791349ffbf-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:36.920980 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.920953    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:35:36.921660 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.921638    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25" event={"ID":"c3428f00-5b59-4790-814d-1c791349ffbf","Type":"ContainerDied","Data":"f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519"}
Oct 31 07:35:36.921773 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.921658    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25"
Oct 31 07:35:36.921773 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:36.921684    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4a80ccf74e467d5cf50e4d8d312386bc82689bda192febf46fa26dedfba8519"
Oct 31 07:35:40.528120 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:35:40.528083    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:35:43.043669 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.043629    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"]
Oct 31 07:35:43.044164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044118    5872 cpu_manager.go:414] "containerMap: removing container" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="extract"
Oct 31 07:35:43.044164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044136    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="extract"
Oct 31 07:35:43.044164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044152    5872 cpu_manager.go:414] "containerMap: removing container" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="util"
Oct 31 07:35:43.044164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044160    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="util"
Oct 31 07:35:43.044378 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044204    5872 cpu_manager.go:414] "containerMap: removing container" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="pull"
Oct 31 07:35:43.044378 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044212    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="pull"
Oct 31 07:35:43.044378 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.044293    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3428f00-5b59-4790-814d-1c791349ffbf" containerName="extract"
Oct 31 07:35:43.047755 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.047735    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.100537 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.100510    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:35:43.150626 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.150600    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:35:43.150626 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.150601    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-bmjtd\""
Oct 31 07:35:43.151690 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.151671    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"]
Oct 31 07:35:43.186520 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.186492    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.186659 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.186529    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.186659 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.186575    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn96v\" (UniqueName: \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.288076 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.288040    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.288234 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.288091    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.288234 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.288165    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96v\" (UniqueName: \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.288508 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.288486    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.288545 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.288492    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.345478 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.345416    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn96v\" (UniqueName: \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.363352 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.363328    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:43.730561 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.730533    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"]
Oct 31 07:35:43.733891 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:35:43.733860    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43364d0c_98bc_4287_9cf0_2cf9d505e6d7.slice/crio-6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead WatchSource:0}: Error finding container 6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead: Status 404 returned error can't find the container with id 6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead
Oct 31 07:35:43.948245 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.948214    5872 generic.go:356] "Generic (PLEG): container finished" podID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerID="c5f24a5d70a8ad375243e9ba9e7f613bf9bef5036e523e029d4c437ec6ee8f1d" exitCode=0
Oct 31 07:35:43.948382 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.948305    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8" event={"ID":"43364d0c-98bc-4287-9cf0-2cf9d505e6d7","Type":"ContainerDied","Data":"c5f24a5d70a8ad375243e9ba9e7f613bf9bef5036e523e029d4c437ec6ee8f1d"}
Oct 31 07:35:43.948382 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:43.948361    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8" event={"ID":"43364d0c-98bc-4287-9cf0-2cf9d505e6d7","Type":"ContainerStarted","Data":"6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead"}
Oct 31 07:35:44.953879 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:44.953842    5872 generic.go:356] "Generic (PLEG): container finished" podID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerID="6d6131ae424b190afda9b46097b323a3eb80a12cd2a10119e9908e5da4761663" exitCode=0
Oct 31 07:35:44.954299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:44.953935    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8" event={"ID":"43364d0c-98bc-4287-9cf0-2cf9d505e6d7","Type":"ContainerDied","Data":"6d6131ae424b190afda9b46097b323a3eb80a12cd2a10119e9908e5da4761663"}
Oct 31 07:35:45.959795 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:45.959765    5872 generic.go:356] "Generic (PLEG): container finished" podID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerID="97a13e2c9a3eb3393da3d63fd25f59270283277dee9a2514216696bafc85800d" exitCode=0
Oct 31 07:35:45.960185 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:45.959837    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8" event={"ID":"43364d0c-98bc-4287-9cf0-2cf9d505e6d7","Type":"ContainerDied","Data":"97a13e2c9a3eb3393da3d63fd25f59270283277dee9a2514216696bafc85800d"}
Oct 31 07:35:47.084592 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.084571    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:47.222680 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.222608    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\") pod \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") "
Oct 31 07:35:47.222680 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.222653    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\") pod \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") "
Oct 31 07:35:47.222873 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.222718    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\" (UniqueName: \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\") pod \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\" (UID: \"43364d0c-98bc-4287-9cf0-2cf9d505e6d7\") "
Oct 31 07:35:47.223307 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.223284    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle" pod "43364d0c-98bc-4287-9cf0-2cf9d505e6d7" (UID: "43364d0c-98bc-4287-9cf0-2cf9d505e6d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:35:47.224748 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.224723    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v" pod "43364d0c-98bc-4287-9cf0-2cf9d505e6d7" (UID: "43364d0c-98bc-4287-9cf0-2cf9d505e6d7"). InnerVolumeSpecName "kube-api-access-sn96v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:35:47.228466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.228442    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util" pod "43364d0c-98bc-4287-9cf0-2cf9d505e6d7" (UID: "43364d0c-98bc-4287-9cf0-2cf9d505e6d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:35:47.323199 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.323178    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn96v\" (UniqueName: \"kubernetes.io/projected/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-kube-api-access-sn96v\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:47.323199 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.323199    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:47.323332 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.323209    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43364d0c-98bc-4287-9cf0-2cf9d505e6d7-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:35:47.971221 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.971195    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8"
Oct 31 07:35:47.971366 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.971199    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbcxq8" event={"ID":"43364d0c-98bc-4287-9cf0-2cf9d505e6d7","Type":"ContainerDied","Data":"6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead"}
Oct 31 07:35:47.971366 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:47.971304    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6276b1916d563e6924afbecfc623f04a08c6c57960244292189e052111c66ead"
Oct 31 07:35:57.461978 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.461943    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"]
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462311    5872 cpu_manager.go:414] "containerMap: removing container" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="util"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462321    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="util"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462340    5872 cpu_manager.go:414] "containerMap: removing container" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="pull"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462346    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="pull"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462357    5872 cpu_manager.go:414] "containerMap: removing container" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="extract"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462362    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="extract"
Oct 31 07:35:57.462458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.462415    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="43364d0c-98bc-4287-9cf0-2cf9d505e6d7" containerName="extract"
Oct 31 07:35:57.468920 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.468903    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.512198 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.512173    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"]
Oct 31 07:35:57.560788 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.560764    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:35:57.560891 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.560807    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p2j27\""
Oct 31 07:35:57.560891 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.560807    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 07:35:57.606176 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.606150    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85wt\" (UniqueName: \"kubernetes.io/projected/a075ecb0-7438-4438-8df3-614f8c20d88d-kube-api-access-n85wt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.606272 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.606196    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a075ecb0-7438-4438-8df3-614f8c20d88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.706857 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.706825    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85wt\" (UniqueName: \"kubernetes.io/projected/a075ecb0-7438-4438-8df3-614f8c20d88d-kube-api-access-n85wt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.707035 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.706873    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a075ecb0-7438-4438-8df3-614f8c20d88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.707232 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.707215    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a075ecb0-7438-4438-8df3-614f8c20d88d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.763699 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.763636    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85wt\" (UniqueName: \"kubernetes.io/projected/a075ecb0-7438-4438-8df3-614f8c20d88d-kube-api-access-n85wt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-w58p9\" (UID: \"a075ecb0-7438-4438-8df3-614f8c20d88d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:57.780456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:57.780437    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"
Oct 31 07:35:58.238805 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:58.238775    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9"]
Oct 31 07:35:58.242217 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:35:58.242176    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda075ecb0_7438_4438_8df3_614f8c20d88d.slice/crio-76f07db7347a2595a2bd5494091ee19a54ee2f7e71235622882c2cf5c63dd705 WatchSource:0}: Error finding container 76f07db7347a2595a2bd5494091ee19a54ee2f7e71235622882c2cf5c63dd705: Status 404 returned error can't find the container with id 76f07db7347a2595a2bd5494091ee19a54ee2f7e71235622882c2cf5c63dd705
Oct 31 07:35:59.018451 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:35:59.018379    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9" event={"ID":"a075ecb0-7438-4438-8df3-614f8c20d88d","Type":"ContainerStarted","Data":"76f07db7347a2595a2bd5494091ee19a54ee2f7e71235622882c2cf5c63dd705"}
Oct 31 07:36:01.030168 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:01.030138    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9" event={"ID":"a075ecb0-7438-4438-8df3-614f8c20d88d","Type":"ContainerStarted","Data":"7bfb9a9e21b4c495692ab284512bab563ac3453aa7811254a4636a14d62af78f"}
Oct 31 07:36:01.261476 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:01.261378    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-w58p9" podStartSLOduration=1.557394674 podStartE2EDuration="4.261361319s" totalImagesPullingTime="2.703966645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:01.211116373 +0000 UTC m=+370.823326116" watchObservedRunningTime="2026-10-31 07:36:01.261361319 +0000 UTC m=+370.873571061"
Oct 31 07:36:09.521830 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.521797    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"]
Oct 31 07:36:09.525593 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.525578    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.578290 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.578261    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:36:09.578440 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.578333    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:36:09.627675 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.627652    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"61b1ff68c7255ee5c5329fe19a5d96293a9578-ce91a85d-dockercfg-wkm5m\""
Oct 31 07:36:09.629237 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.629217    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"]
Oct 31 07:36:09.710727 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.710699    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.710862 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.710730    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p664w\" (UniqueName: \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.710862 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.710771    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.812261 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.812187    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.812261 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.812217    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p664w\" (UniqueName: \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.812474 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.812358    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.812652 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.812630    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.812729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.812713    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:09.868846 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:09.868816    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p664w\" (UniqueName: \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:10.141223 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:10.141142    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:10.511417 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:10.511388    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"]
Oct 31 07:36:10.514329 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:10.514303    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe8a65c_d61a_4e69_a47b_2977bfb7e608.slice/crio-366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5 WatchSource:0}: Error finding container 366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5: Status 404 returned error can't find the container with id 366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5
Oct 31 07:36:10.530442 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:36:10.530415    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:36:11.073646 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:11.073615    5872 generic.go:356] "Generic (PLEG): container finished" podID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerID="f24cbf6b81556ee26c6ab141721829349518944c8fa744d0ca726b1398ba995c" exitCode=0
Oct 31 07:36:11.073824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:11.073710    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerDied","Data":"f24cbf6b81556ee26c6ab141721829349518944c8fa744d0ca726b1398ba995c"}
Oct 31 07:36:11.073824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:11.073771    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerStarted","Data":"366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5"}
Oct 31 07:36:14.089992 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:14.089951    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerStarted","Data":"f7e546de4e5e6b24d5cf677eeb78977d747bfc5a2b401b540ea0e41357fb4dc8"}
Oct 31 07:36:15.100847 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:15.100814    5872 generic.go:356] "Generic (PLEG): container finished" podID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerID="f7e546de4e5e6b24d5cf677eeb78977d747bfc5a2b401b540ea0e41357fb4dc8" exitCode=0
Oct 31 07:36:15.101250 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:15.100876    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerDied","Data":"f7e546de4e5e6b24d5cf677eeb78977d747bfc5a2b401b540ea0e41357fb4dc8"}
Oct 31 07:36:16.106920 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:16.106883    5872 generic.go:356] "Generic (PLEG): container finished" podID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerID="26ea7926e2024a007126ed7a58858d1a3b3b83518f98c8d75682f68f600fd7f7" exitCode=0
Oct 31 07:36:16.107318 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:16.106978    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerDied","Data":"26ea7926e2024a007126ed7a58858d1a3b3b83518f98c8d75682f68f600fd7f7"}
Oct 31 07:36:17.230609 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.230583    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:17.268318 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.268285    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\") pod \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") "
Oct 31 07:36:17.268421 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.268348    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\") pod \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") "
Oct 31 07:36:17.268421 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.268386    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\" (UniqueName: \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\") pod \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\" (UID: \"0fe8a65c-d61a-4e69-a47b-2977bfb7e608\") "
Oct 31 07:36:17.268681 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.268659    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle" pod "0fe8a65c-d61a-4e69-a47b-2977bfb7e608" (UID: "0fe8a65c-d61a-4e69-a47b-2977bfb7e608"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:36:17.270314 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.270287    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w" pod "0fe8a65c-d61a-4e69-a47b-2977bfb7e608" (UID: "0fe8a65c-d61a-4e69-a47b-2977bfb7e608"). InnerVolumeSpecName "kube-api-access-p664w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:17.272878 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.272850    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util" pod "0fe8a65c-d61a-4e69-a47b-2977bfb7e608" (UID: "0fe8a65c-d61a-4e69-a47b-2977bfb7e608"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:36:17.369101 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.369028    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:36:17.369101 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.369066    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p664w\" (UniqueName: \"kubernetes.io/projected/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-kube-api-access-p664w\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:36:17.369101 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:17.369077    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fe8a65c-d61a-4e69-a47b-2977bfb7e608-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:36:18.116743 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:18.116717    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk"
Oct 31 07:36:18.116908 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:18.116717    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85vwgdk" event={"ID":"0fe8a65c-d61a-4e69-a47b-2977bfb7e608","Type":"ContainerDied","Data":"366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5"}
Oct 31 07:36:18.116908 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:18.116831    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="366d05a0ed9ab3995ae497616ace32ecd5d080861cf050d461df2d609bcee0f5"
Oct 31 07:36:22.051587 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051552    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"]
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051890    5872 cpu_manager.go:414] "containerMap: removing container" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="extract"
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051901    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="extract"
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051913    5872 cpu_manager.go:414] "containerMap: removing container" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="util"
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051918    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="util"
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051931    5872 cpu_manager.go:414] "containerMap: removing container" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="pull"
Oct 31 07:36:22.051983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.051936    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="pull"
Oct 31 07:36:22.052170 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.052035    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fe8a65c-d61a-4e69-a47b-2977bfb7e608" containerName="extract"
Oct 31 07:36:22.057201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.057182    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.109652 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.109628    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5a2103-dc40-44af-9071-c06518520731-tmp\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.109753 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.109693    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szv7k\" (UniqueName: \"kubernetes.io/projected/6e5a2103-dc40-44af-9071-c06518520731-kube-api-access-szv7k\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.161079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.161041    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:36:22.161079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.161060    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 31 07:36:22.161266 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.161102    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rxm6n\""
Oct 31 07:36:22.162226 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.162207    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"]
Oct 31 07:36:22.210311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.210289    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szv7k\" (UniqueName: \"kubernetes.io/projected/6e5a2103-dc40-44af-9071-c06518520731-kube-api-access-szv7k\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.210420 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.210325    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5a2103-dc40-44af-9071-c06518520731-tmp\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.210685 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.210669    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5a2103-dc40-44af-9071-c06518520731-tmp\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.266807 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.266783    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szv7k\" (UniqueName: \"kubernetes.io/projected/6e5a2103-dc40-44af-9071-c06518520731-kube-api-access-szv7k\") pod \"openshift-lws-operator-8465994787-z6n76\" (UID: \"6e5a2103-dc40-44af-9071-c06518520731\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.382935 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.382872    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"
Oct 31 07:36:22.750148 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:22.749996    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-z6n76"]
Oct 31 07:36:22.752880 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:22.752853    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e5a2103_dc40_44af_9071_c06518520731.slice/crio-5881615f1abda9d4666f68f5b11dd8d5cedcc4639c6f29c219bcc0a013bfb54e WatchSource:0}: Error finding container 5881615f1abda9d4666f68f5b11dd8d5cedcc4639c6f29c219bcc0a013bfb54e: Status 404 returned error can't find the container with id 5881615f1abda9d4666f68f5b11dd8d5cedcc4639c6f29c219bcc0a013bfb54e
Oct 31 07:36:23.141530 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:23.141454    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76" event={"ID":"6e5a2103-dc40-44af-9071-c06518520731","Type":"ContainerStarted","Data":"5881615f1abda9d4666f68f5b11dd8d5cedcc4639c6f29c219bcc0a013bfb54e"}
Oct 31 07:36:26.155593 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:26.155558    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76" event={"ID":"6e5a2103-dc40-44af-9071-c06518520731","Type":"ContainerStarted","Data":"1e8112cd31221f962c3e895f5af7e446b7b253119478fcd4364e40260e18f373"}
Oct 31 07:36:26.269808 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:26.269754    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-8465994787-z6n76" podStartSLOduration=1.385033124 podStartE2EDuration="4.269738516s" totalImagesPullingTime="2.884705392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:26.267703694 +0000 UTC m=+395.879913440" watchObservedRunningTime="2026-10-31 07:36:26.269738516 +0000 UTC m=+395.881948256"
Oct 31 07:36:35.673628 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.673577    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:36:35.677187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.677164    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722298 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722266    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mj6v\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722487 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722310    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722487 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722335    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722487 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722383    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722646 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722497    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722646 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722555    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.722646 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.722591    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.733574 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733548    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 07:36:35.733574 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733548    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 07:36:35.733734 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733685    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 07:36:35.733734 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733722    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h8dlt\""
Oct 31 07:36:35.733813 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733733    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 07:36:35.733857 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.733819    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 07:36:35.783255 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.783224    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 07:36:35.784781 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.784756    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:36:35.823482 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823455    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823482 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823484    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823668 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823517    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823668 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823543    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823668 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823582    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823668 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823644    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mj6v\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.823891 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.823687    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.824281 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.824253    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.826064 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.826042    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.826167 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.826142    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.826508 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.826486    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.826508 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.826504    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.880307 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.880277    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.880707 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.880688    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mj6v\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\") pod \"istiod-openshift-gateway-7876bfcb74-77mz6\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:35.988701 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:35.988608    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:36.423007 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:36.422847    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:36:36.425449 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:36.425421    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55f599_5881_44a6_8e91_f8d97fe88163.slice/crio-b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022 WatchSource:0}: Error finding container b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022: Status 404 returned error can't find the container with id b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022
Oct 31 07:36:37.207048 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:37.207013    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" event={"ID":"ee55f599-5881-44a6-8e91-f8d97fe88163","Type":"ContainerStarted","Data":"b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022"}
Oct 31 07:36:39.996618 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:39.996582    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:36:39.996925 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:39.996648    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:36:40.222239 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:40.222197    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" event={"ID":"ee55f599-5881-44a6-8e91-f8d97fe88163","Type":"ContainerStarted","Data":"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"}
Oct 31 07:36:40.222422 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:40.222290    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:40.429680 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:40.429623    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" podStartSLOduration=1.861348164 podStartE2EDuration="5.429610094s" totalImagesPullingTime="3.56826193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:40.429047637 +0000 UTC m=+410.041257378" watchObservedRunningTime="2026-10-31 07:36:40.429610094 +0000 UTC m=+410.041819835"
Oct 31 07:36:40.527298 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:36:40.527262    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:36:41.228442 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:41.228403    5872 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-77mz6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:36:41.228824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:41.228474    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:36:44.227389 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:44.227356    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:36:45.220651 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.220617    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 07:36:45.224368 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.224348    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.307045 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.307013    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-z29g8\""
Oct 31 07:36:45.309385 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309357    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309504 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309390    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309504 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309416    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309504 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309476    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309533    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309578    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309607 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309597    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309748 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309625    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.309748 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.309690    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bjl8\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.327897 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.327874    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 07:36:45.411084 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411053    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411084 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411086    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411312 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411116    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411312 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411140    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411312 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411167    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411312 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411214    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411499 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411343    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411499 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411416    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411499 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411444    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bjl8\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411624 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411503    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411671 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411658    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411729 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411698    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.411791 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.411770    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.412175 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.412156    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.413580 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.413550    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.413869 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.413852    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.467713 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.467686    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.467894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.467877    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bjl8\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.537039 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.536957    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:45.958662 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:45.958543    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 07:36:45.961069 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:45.961038    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359fce47_4af6_4aa2_a6e0_688dfab34dbc.slice/crio-933440853be8f58d13b6f9b539516096aa6978f89f5170f7141c7e03c5b73752 WatchSource:0}: Error finding container 933440853be8f58d13b6f9b539516096aa6978f89f5170f7141c7e03c5b73752: Status 404 returned error can't find the container with id 933440853be8f58d13b6f9b539516096aa6978f89f5170f7141c7e03c5b73752
Oct 31 07:36:46.253684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:46.253606    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerStarted","Data":"933440853be8f58d13b6f9b539516096aa6978f89f5170f7141c7e03c5b73752"}
Oct 31 07:36:49.605457 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:49.605425    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:36:49.605711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:49.605490    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:36:49.605711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:49.605519    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:36:50.273299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:50.273265    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerStarted","Data":"68760d836d42e10aabbd4d812bd9c1334959e8bc6e7d4de736cf70128beb2158"}
Oct 31 07:36:50.537650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:50.537566    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:50.542276 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:50.542252    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:50.704342 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:50.704290    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podStartSLOduration=2.062673488 podStartE2EDuration="5.70427779s" totalImagesPullingTime="3.641604302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:50.488245848 +0000 UTC m=+420.100455590" watchObservedRunningTime="2026-10-31 07:36:50.70427779 +0000 UTC m=+420.316487529"
Oct 31 07:36:51.278264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:51.278234    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:51.279670 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:51.279651    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:36:54.311652 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.311614    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"]
Oct 31 07:36:54.315620 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.315600    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.420548 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.420511    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:36:54.420759 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.420575    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:36:54.420759 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.420596    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-t5zvh\""
Oct 31 07:36:54.422014 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.421994    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"]
Oct 31 07:36:54.423041 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.423023    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"]
Oct 31 07:36:54.426516 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.426498    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.481902 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.481872    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-j58j4\""
Oct 31 07:36:54.483529 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.483499    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"]
Oct 31 07:36:54.494074 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.494052    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.494197 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.494086    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9wd\" (UniqueName: \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.494197 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.494112    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.516827 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.516805    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"]
Oct 31 07:36:54.520302 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.520287    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.577696 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.577617    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"]
Oct 31 07:36:54.583320 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.583277    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-mfbwh\""
Oct 31 07:36:54.594636 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594609    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.594741 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594649    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9wd\" (UniqueName: \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.594741 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594701    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.594828 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594777    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.594884 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594829    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkv8b\" (UniqueName: \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.594884 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.594856    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.595105 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.595087    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.595201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.595179    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.613543 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.613517    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"]
Oct 31 07:36:54.619208 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.619181    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.651252 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.651226    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9wd\" (UniqueName: \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.672628 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.672604    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"]
Oct 31 07:36:54.685058 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.685037    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-zn5ht\""
Oct 31 07:36:54.695743 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.695721    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.695847 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.695761    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dhv5\" (UniqueName: \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.695917 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.695871    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.696028 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.696011    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.696094 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.696049    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkv8b\" (UniqueName: \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.696148 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.696092    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.696357 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.696340    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.696431 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.696385    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.752823 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.752796    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkv8b\" (UniqueName: \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:54.797452 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797417    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.797600 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797541    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.797600 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797581    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzt4h\" (UniqueName: \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.797719 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797613    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dhv5\" (UniqueName: \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.797719 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797700    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.797803 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797738    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.797936 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.797912    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.798107 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.798061    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.854149 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.854083    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dhv5\" (UniqueName: \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:54.898336 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.898308    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzt4h\" (UniqueName: \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.898486 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.898367    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.898486 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.898391    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.898786 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.898767    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.898824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.898781    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:54.932169 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.932145    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:36:54.957715 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:54.957683    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzt4h\" (UniqueName: \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:55.042328 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.042299    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:36:55.136419 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.136344    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:36:55.235599 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.235571    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:36:55.305364 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.305341    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"]
Oct 31 07:36:55.307783 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:55.307258    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249357be_aa3e_4aab_83f7_e5622f046ad1.slice/crio-cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4 WatchSource:0}: Error finding container cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4: Status 404 returned error can't find the container with id cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4
Oct 31 07:36:55.414749 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.414725    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"]
Oct 31 07:36:55.461910 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:55.461877    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c57560_e9fa_4b33_9436_7787f2680e27.slice/crio-db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf WatchSource:0}: Error finding container db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf: Status 404 returned error can't find the container with id db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf
Oct 31 07:36:55.506739 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.506708    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"]
Oct 31 07:36:55.509652 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:55.509627    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2729db_a310_4f6e_b046_d69eddceb330.slice/crio-dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d WatchSource:0}: Error finding container dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d: Status 404 returned error can't find the container with id dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d
Oct 31 07:36:55.605542 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:55.605515    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"]
Oct 31 07:36:55.685933 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:36:55.685901    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b27207d_75c7_4d3c_8e5b_ea70df2a5ed8.slice/crio-d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d WatchSource:0}: Error finding container d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d: Status 404 returned error can't find the container with id d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d
Oct 31 07:36:56.304066 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.304028    5872 generic.go:356] "Generic (PLEG): container finished" podID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerID="b5e48f2b2b059599557d9ae5a34479bf21fe741b7d45fa666bac05a757c15ea3" exitCode=0
Oct 31 07:36:56.304258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.304107    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv" event={"ID":"e3c57560-e9fa-4b33-9436-7787f2680e27","Type":"ContainerDied","Data":"b5e48f2b2b059599557d9ae5a34479bf21fe741b7d45fa666bac05a757c15ea3"}
Oct 31 07:36:56.304258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.304156    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv" event={"ID":"e3c57560-e9fa-4b33-9436-7787f2680e27","Type":"ContainerStarted","Data":"db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf"}
Oct 31 07:36:56.306590 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.306571    5872 generic.go:356] "Generic (PLEG): container finished" podID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerID="5617b018a49e26131d922892587246d4f89539add6887b5f5070452490aad1c0" exitCode=0
Oct 31 07:36:56.306695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.306629    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c" event={"ID":"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8","Type":"ContainerDied","Data":"5617b018a49e26131d922892587246d4f89539add6887b5f5070452490aad1c0"}
Oct 31 07:36:56.306695 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.306677    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c" event={"ID":"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8","Type":"ContainerStarted","Data":"d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d"}
Oct 31 07:36:56.308328 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.308276    5872 generic.go:356] "Generic (PLEG): container finished" podID="cf2729db-a310-4f6e-b046-d69eddceb330" containerID="47e00acce4ddb6e84fd6fe24193c29edb75bdc70c8e659ffff8e0aceb0fb5095" exitCode=0
Oct 31 07:36:56.308429 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.308380    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75" event={"ID":"cf2729db-a310-4f6e-b046-d69eddceb330","Type":"ContainerDied","Data":"47e00acce4ddb6e84fd6fe24193c29edb75bdc70c8e659ffff8e0aceb0fb5095"}
Oct 31 07:36:56.308429 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.308420    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75" event={"ID":"cf2729db-a310-4f6e-b046-d69eddceb330","Type":"ContainerStarted","Data":"dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d"}
Oct 31 07:36:56.310102 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.310080    5872 generic.go:356] "Generic (PLEG): container finished" podID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerID="f273aac308a212c0d150c1e4ea3b69bc93c474954cce14a1eba7811a3a516288" exitCode=0
Oct 31 07:36:56.310187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.310114    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t" event={"ID":"249357be-aa3e-4aab-83f7-e5622f046ad1","Type":"ContainerDied","Data":"f273aac308a212c0d150c1e4ea3b69bc93c474954cce14a1eba7811a3a516288"}
Oct 31 07:36:56.310187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:56.310146    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t" event={"ID":"249357be-aa3e-4aab-83f7-e5622f046ad1","Type":"ContainerStarted","Data":"cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4"}
Oct 31 07:36:58.329100 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.329063    5872 generic.go:356] "Generic (PLEG): container finished" podID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerID="bfb569389e63cba3a610be57e8115abbb2a1647b16d21e2042582735fc593482" exitCode=0
Oct 31 07:36:58.329503 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.329409    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c" event={"ID":"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8","Type":"ContainerDied","Data":"bfb569389e63cba3a610be57e8115abbb2a1647b16d21e2042582735fc593482"}
Oct 31 07:36:58.331401 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.331377    5872 generic.go:356] "Generic (PLEG): container finished" podID="cf2729db-a310-4f6e-b046-d69eddceb330" containerID="8e46de705832166c71f52c37918dc67f0fa35af3971dbf8ad8cc942a3ad8b907" exitCode=0
Oct 31 07:36:58.331599 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.331452    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75" event={"ID":"cf2729db-a310-4f6e-b046-d69eddceb330","Type":"ContainerDied","Data":"8e46de705832166c71f52c37918dc67f0fa35af3971dbf8ad8cc942a3ad8b907"}
Oct 31 07:36:58.334571 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.334545    5872 generic.go:356] "Generic (PLEG): container finished" podID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerID="7b41571637b0d9257e6ef8061d413d6ec0fa3b5bb88436c0d2590a9d57704436" exitCode=0
Oct 31 07:36:58.334670 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.334570    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t" event={"ID":"249357be-aa3e-4aab-83f7-e5622f046ad1","Type":"ContainerDied","Data":"7b41571637b0d9257e6ef8061d413d6ec0fa3b5bb88436c0d2590a9d57704436"}
Oct 31 07:36:58.336546 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.336520    5872 generic.go:356] "Generic (PLEG): container finished" podID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerID="7f00081f6bf054d1d8556219d9e8f6f25db1244ef60d809fe02883239422b424" exitCode=0
Oct 31 07:36:58.336632 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:58.336572    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv" event={"ID":"e3c57560-e9fa-4b33-9436-7787f2680e27","Type":"ContainerDied","Data":"7f00081f6bf054d1d8556219d9e8f6f25db1244ef60d809fe02883239422b424"}
Oct 31 07:36:59.343471 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.343441    5872 generic.go:356] "Generic (PLEG): container finished" podID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerID="64425a684cb315d683ccf0215284685d1c5fffa0e2d272fe5ceac5530133b27c" exitCode=0
Oct 31 07:36:59.343950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.343502    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t" event={"ID":"249357be-aa3e-4aab-83f7-e5622f046ad1","Type":"ContainerDied","Data":"64425a684cb315d683ccf0215284685d1c5fffa0e2d272fe5ceac5530133b27c"}
Oct 31 07:36:59.345716 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.345695    5872 generic.go:356] "Generic (PLEG): container finished" podID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerID="e5586ace1b993de49a660238f1bd41434b3e7d104ecd1f8e83753566c8616127" exitCode=0
Oct 31 07:36:59.345814 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.345776    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv" event={"ID":"e3c57560-e9fa-4b33-9436-7787f2680e27","Type":"ContainerDied","Data":"e5586ace1b993de49a660238f1bd41434b3e7d104ecd1f8e83753566c8616127"}
Oct 31 07:36:59.347661 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.347643    5872 generic.go:356] "Generic (PLEG): container finished" podID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerID="808a4c71aad27a87cf233554b58aef513b746ad7922a41756d2e576918d7beaa" exitCode=0
Oct 31 07:36:59.347748 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.347682    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c" event={"ID":"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8","Type":"ContainerDied","Data":"808a4c71aad27a87cf233554b58aef513b746ad7922a41756d2e576918d7beaa"}
Oct 31 07:36:59.349675 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.349653    5872 generic.go:356] "Generic (PLEG): container finished" podID="cf2729db-a310-4f6e-b046-d69eddceb330" containerID="52d2d2941035448074955fe8056f5e622305b41129e29d954b99cdb6ca406225" exitCode=0
Oct 31 07:36:59.349753 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:36:59.349694    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75" event={"ID":"cf2729db-a310-4f6e-b046-d69eddceb330","Type":"ContainerDied","Data":"52d2d2941035448074955fe8056f5e622305b41129e29d954b99cdb6ca406225"}
Oct 31 07:37:00.492891 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.492866    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:37:00.562196 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.562171    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:37:00.565254 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.565231    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:37:00.568792 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.568775    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:37:00.652545 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652475    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\" (UniqueName: \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\") pod \"249357be-aa3e-4aab-83f7-e5622f046ad1\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") "
Oct 31 07:37:00.652545 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652509    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\") pod \"249357be-aa3e-4aab-83f7-e5622f046ad1\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") "
Oct 31 07:37:00.652545 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652534    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\") pod \"cf2729db-a310-4f6e-b046-d69eddceb330\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") "
Oct 31 07:37:00.652824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652623    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\") pod \"cf2729db-a310-4f6e-b046-d69eddceb330\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") "
Oct 31 07:37:00.652824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652661    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\" (UniqueName: \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\") pod \"cf2729db-a310-4f6e-b046-d69eddceb330\" (UID: \"cf2729db-a310-4f6e-b046-d69eddceb330\") "
Oct 31 07:37:00.652824 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.652721    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\") pod \"249357be-aa3e-4aab-83f7-e5622f046ad1\" (UID: \"249357be-aa3e-4aab-83f7-e5622f046ad1\") "
Oct 31 07:37:00.653263 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.653235    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle" pod "cf2729db-a310-4f6e-b046-d69eddceb330" (UID: "cf2729db-a310-4f6e-b046-d69eddceb330"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.653649 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.653616    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle" pod "249357be-aa3e-4aab-83f7-e5622f046ad1" (UID: "249357be-aa3e-4aab-83f7-e5622f046ad1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.654802 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.654783    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd" pod "249357be-aa3e-4aab-83f7-e5622f046ad1" (UID: "249357be-aa3e-4aab-83f7-e5622f046ad1"). InnerVolumeSpecName "kube-api-access-tz9wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:37:00.655159 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.655126    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5" pod "cf2729db-a310-4f6e-b046-d69eddceb330" (UID: "cf2729db-a310-4f6e-b046-d69eddceb330"). InnerVolumeSpecName "kube-api-access-7dhv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:37:00.658730 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.658702    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util" pod "cf2729db-a310-4f6e-b046-d69eddceb330" (UID: "cf2729db-a310-4f6e-b046-d69eddceb330"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.659083 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.659063    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util" pod "249357be-aa3e-4aab-83f7-e5622f046ad1" (UID: "249357be-aa3e-4aab-83f7-e5622f046ad1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.753904 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.753868    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\") pod \"e3c57560-e9fa-4b33-9436-7787f2680e27\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") "
Oct 31 07:37:00.754109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.753914    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\") pod \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") "
Oct 31 07:37:00.754109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.753935    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\" (UniqueName: \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\") pod \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") "
Oct 31 07:37:00.754109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.753984    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\") pod \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\" (UID: \"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8\") "
Oct 31 07:37:00.754109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754045    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\" (UniqueName: \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\") pod \"e3c57560-e9fa-4b33-9436-7787f2680e27\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") "
Oct 31 07:37:00.754109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754101    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\") pod \"e3c57560-e9fa-4b33-9436-7787f2680e27\" (UID: \"e3c57560-e9fa-4b33-9436-7787f2680e27\") "
Oct 31 07:37:00.754408 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754384    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754411    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dhv5\" (UniqueName: \"kubernetes.io/projected/cf2729db-a310-4f6e-b046-d69eddceb330-kube-api-access-7dhv5\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754428    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754422    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle" pod "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" (UID: "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754441    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz9wd\" (UniqueName: \"kubernetes.io/projected/249357be-aa3e-4aab-83f7-e5622f046ad1-kube-api-access-tz9wd\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754454    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249357be-aa3e-4aab-83f7-e5622f046ad1-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754538 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754467    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf2729db-a310-4f6e-b046-d69eddceb330-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.754980 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.754928    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle" pod "e3c57560-e9fa-4b33-9436-7787f2680e27" (UID: "e3c57560-e9fa-4b33-9436-7787f2680e27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.756220 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.756195    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h" pod "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" (UID: "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8"). InnerVolumeSpecName "kube-api-access-pzt4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:37:00.756283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.756258    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b" pod "e3c57560-e9fa-4b33-9436-7787f2680e27" (UID: "e3c57560-e9fa-4b33-9436-7787f2680e27"). InnerVolumeSpecName "kube-api-access-nkv8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:37:00.759723 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.759690    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util" pod "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" (UID: "3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.815730 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.815695    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util" pod "e3c57560-e9fa-4b33-9436-7787f2680e27" (UID: "e3c57560-e9fa-4b33-9436-7787f2680e27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:37:00.855465 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855428    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkv8b\" (UniqueName: \"kubernetes.io/projected/e3c57560-e9fa-4b33-9436-7787f2680e27-kube-api-access-nkv8b\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.855465 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855462    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.855677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855476    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c57560-e9fa-4b33-9436-7787f2680e27-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.855677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855489    5872 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-bundle\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.855677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855501    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzt4h\" (UniqueName: \"kubernetes.io/projected/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-kube-api-access-pzt4h\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:00.855677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:00.855512    5872 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8-util\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:37:01.364296 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.364258    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t" event={"ID":"249357be-aa3e-4aab-83f7-e5622f046ad1","Type":"ContainerDied","Data":"cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4"}
Oct 31 07:37:01.364570 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.364339    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cddc5cddc60ebc75561f9c2c19c328245d9ddee89954d08efd9c5253fb86cba4"
Oct 31 07:37:01.364570 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.364269    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqft8t"
Oct 31 07:37:01.365901 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.365879    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv" event={"ID":"e3c57560-e9fa-4b33-9436-7787f2680e27","Type":"ContainerDied","Data":"db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf"}
Oct 31 07:37:01.366018 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.365912    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db506c1f4fbeab11116b94c1b0ffcbc5461fe073d47032b35f481f644de790bf"
Oct 31 07:37:01.366018 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.365978    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c7zgv"
Oct 31 07:37:01.369054 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.369026    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c" event={"ID":"3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8","Type":"ContainerDied","Data":"d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d"}
Oct 31 07:37:01.369151 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.369064    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d356ca0c1d40a1217332d16b59acfe2faa51d9d3357764c09e2303b7cc69956d"
Oct 31 07:37:01.369151 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.369032    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vks9c"
Oct 31 07:37:01.371191 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.371171    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75" event={"ID":"cf2729db-a310-4f6e-b046-d69eddceb330","Type":"ContainerDied","Data":"dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d"}
Oct 31 07:37:01.371301 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.371202    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc9bcc679b11cee0c81cf2c183fb83f8d815da7302f1f17327569ed52613f27d"
Oct 31 07:37:01.371301 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:01.371221    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5lw75"
Oct 31 07:37:10.528280 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:37:10.528243    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:37:10.694670 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.694637    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"]
Oct 31 07:37:10.695011 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.694999    5872 cpu_manager.go:414] "containerMap: removing container" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="util"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695012    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="util"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695026    5872 cpu_manager.go:414] "containerMap: removing container" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="pull"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695031    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="pull"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695042    5872 cpu_manager.go:414] "containerMap: removing container" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="pull"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695048    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="pull"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695058    5872 cpu_manager.go:414] "containerMap: removing container" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="util"
Oct 31 07:37:10.695067 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695062    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="util"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695071    5872 cpu_manager.go:414] "containerMap: removing container" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695076    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695081    5872 cpu_manager.go:414] "containerMap: removing container" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695085    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695097    5872 cpu_manager.go:414] "containerMap: removing container" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="util"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695101    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="util"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695106    5872 cpu_manager.go:414] "containerMap: removing container" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="pull"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695111    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="pull"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695116    5872 cpu_manager.go:414] "containerMap: removing container" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="pull"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695120    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="pull"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695128    5872 cpu_manager.go:414] "containerMap: removing container" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695132    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695140    5872 cpu_manager.go:414] "containerMap: removing container" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="util"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695144    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="util"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695152    5872 cpu_manager.go:414] "containerMap: removing container" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695156    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695210    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf2729db-a310-4f6e-b046-d69eddceb330" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695221    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b27207d-75c7-4d3c-8e5b-ea70df2a5ed8" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695226    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="249357be-aa3e-4aab-83f7-e5622f046ad1" containerName="extract"
Oct 31 07:37:10.695264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.695233    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3c57560-e9fa-4b33-9436-7787f2680e27" containerName="extract"
Oct 31 07:37:10.702263 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.702244    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:10.728394 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.728372    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hl5v\" (UniqueName: \"kubernetes.io/projected/7547ba70-7b80-4629-9a56-b5050e891e2b-kube-api-access-6hl5v\") pod \"limitador-operator-controller-manager-69b7bb8c5c-mflcb\" (UID: \"7547ba70-7b80-4629-9a56-b5050e891e2b\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:10.809521 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.809442    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 07:37:10.809671 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.809543    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dwkd8\""
Oct 31 07:37:10.809671 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.809583    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 07:37:10.811256 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.811238    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"]
Oct 31 07:37:10.829055 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.829029    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hl5v\" (UniqueName: \"kubernetes.io/projected/7547ba70-7b80-4629-9a56-b5050e891e2b-kube-api-access-6hl5v\") pod \"limitador-operator-controller-manager-69b7bb8c5c-mflcb\" (UID: \"7547ba70-7b80-4629-9a56-b5050e891e2b\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:10.887396 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:10.887373    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hl5v\" (UniqueName: \"kubernetes.io/projected/7547ba70-7b80-4629-9a56-b5050e891e2b-kube-api-access-6hl5v\") pod \"limitador-operator-controller-manager-69b7bb8c5c-mflcb\" (UID: \"7547ba70-7b80-4629-9a56-b5050e891e2b\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:11.015920 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:11.015892    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:11.385124 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:11.385058    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"]
Oct 31 07:37:11.387905 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:37:11.387875    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7547ba70_7b80_4629_9a56_b5050e891e2b.slice/crio-1daf64e90e2827632f4ef9a82e4a4671f12b8053d831bec6d152872d604e2cdb WatchSource:0}: Error finding container 1daf64e90e2827632f4ef9a82e4a4671f12b8053d831bec6d152872d604e2cdb: Status 404 returned error can't find the container with id 1daf64e90e2827632f4ef9a82e4a4671f12b8053d831bec6d152872d604e2cdb
Oct 31 07:37:11.420202 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:11.420172    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb" event={"ID":"7547ba70-7b80-4629-9a56-b5050e891e2b","Type":"ContainerStarted","Data":"1daf64e90e2827632f4ef9a82e4a4671f12b8053d831bec6d152872d604e2cdb"}
Oct 31 07:37:15.443511 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:15.443473    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb" event={"ID":"7547ba70-7b80-4629-9a56-b5050e891e2b","Type":"ContainerStarted","Data":"cef86d42ba49a71de22643de64efe90d4ef11bc2db028e620a9dc59c2ead224b"}
Oct 31 07:37:15.443913 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:15.443560    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:15.566484 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:15.566434    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb" podStartSLOduration=2.15105643 podStartE2EDuration="5.566420892s" totalImagesPullingTime="3.415364462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:15.565366593 +0000 UTC m=+445.177576337" watchObservedRunningTime="2026-10-31 07:37:15.566420892 +0000 UTC m=+445.178630635"
Oct 31 07:37:26.452002 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:37:26.451959    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-mflcb"
Oct 31 07:37:40.526519 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:37:40.526438    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:38:10.527553 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:38:10.527512    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:38:13.244056 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.244018    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:13.249025 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.248996    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.280813 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.280787    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjzt\" (UniqueName: \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.280923 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.280839    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.303315 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.303296    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2mh85\""
Oct 31 07:38:13.352815 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.352792    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 07:38:13.354482 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.354462    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:13.381452 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.381427    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjzt\" (UniqueName: \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.381560 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.381469    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.382051 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.382035    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.440851 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.440829    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjzt\" (UniqueName: \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\") pod \"limitador-limitador-74dfcfb894-6gl9x\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.483434 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.483410    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:13.562638 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.562566    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:13.934264 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:13.934242    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:13.936709 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:38:13.936680    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1d8b9b_48ca_41bf_9749_3e3450e14143.slice/crio-2afdb016c7e135a3fbd5f65f98f4920784303f0327b403cc42434a7572d8609a WatchSource:0}: Error finding container 2afdb016c7e135a3fbd5f65f98f4920784303f0327b403cc42434a7572d8609a: Status 404 returned error can't find the container with id 2afdb016c7e135a3fbd5f65f98f4920784303f0327b403cc42434a7572d8609a
Oct 31 07:38:14.729208 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:14.729173    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" event={"ID":"bd1d8b9b-48ca-41bf-9749-3e3450e14143","Type":"ContainerStarted","Data":"2afdb016c7e135a3fbd5f65f98f4920784303f0327b403cc42434a7572d8609a"}
Oct 31 07:38:16.742300 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:16.742266    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" event={"ID":"bd1d8b9b-48ca-41bf-9749-3e3450e14143","Type":"ContainerStarted","Data":"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"}
Oct 31 07:38:16.742743 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:16.742327    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:16.855322 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:16.855270    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" podStartSLOduration=1.719032814 podStartE2EDuration="3.855256334s" totalImagesPullingTime="2.13622352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:16.854156309 +0000 UTC m=+506.466366042" watchObservedRunningTime="2026-10-31 07:38:16.855256334 +0000 UTC m=+506.467466077"
Oct 31 07:38:17.288842 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.288808    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-pdw96"]
Oct 31 07:38:17.292367 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.292352    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.349178 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.349150    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-pdw96"]
Oct 31 07:38:17.414845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.414813    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1381480d-ca82-436b-90be-2ed2fe060f02-config-file\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.415005 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.414883    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vp78\" (UniqueName: \"kubernetes.io/projected/1381480d-ca82-436b-90be-2ed2fe060f02-kube-api-access-7vp78\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.516144 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.516114    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vp78\" (UniqueName: \"kubernetes.io/projected/1381480d-ca82-436b-90be-2ed2fe060f02-kube-api-access-7vp78\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.516283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.516169    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1381480d-ca82-436b-90be-2ed2fe060f02-config-file\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.516731 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.516714    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1381480d-ca82-436b-90be-2ed2fe060f02-config-file\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.571845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.571790    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vp78\" (UniqueName: \"kubernetes.io/projected/1381480d-ca82-436b-90be-2ed2fe060f02-kube-api-access-7vp78\") pod \"limitador-limitador-7c9b87d574-pdw96\" (UID: \"1381480d-ca82-436b-90be-2ed2fe060f02\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.601612 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.601570    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-pdw96"]
Oct 31 07:38:17.604805 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.604787    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:17.973137 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:17.973111    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-pdw96"]
Oct 31 07:38:17.975464 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:38:17.975434    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1381480d_ca82_436b_90be_2ed2fe060f02.slice/crio-c40b69faa7ae1e10e7d36bd186010102b307023913273b4da6a51e8bd3327cfa WatchSource:0}: Error finding container c40b69faa7ae1e10e7d36bd186010102b307023913273b4da6a51e8bd3327cfa: Status 404 returned error can't find the container with id c40b69faa7ae1e10e7d36bd186010102b307023913273b4da6a51e8bd3327cfa
Oct 31 07:38:18.753906 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:18.753865    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96" event={"ID":"1381480d-ca82-436b-90be-2ed2fe060f02","Type":"ContainerStarted","Data":"ad28d53b95f363d7fbcb56851553121f18b30a523608f78c3f81c576122c4e6e"}
Oct 31 07:38:18.754112 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:18.753917    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96" event={"ID":"1381480d-ca82-436b-90be-2ed2fe060f02","Type":"ContainerStarted","Data":"c40b69faa7ae1e10e7d36bd186010102b307023913273b4da6a51e8bd3327cfa"}
Oct 31 07:38:18.754112 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:18.753994    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:18.867424 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:18.867360    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96" podStartSLOduration=1.867346859 podStartE2EDuration="1.867346859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:18.866318918 +0000 UTC m=+508.478528660" watchObservedRunningTime="2026-10-31 07:38:18.867346859 +0000 UTC m=+508.479556600"
Oct 31 07:38:27.749104 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:27.749076    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:29.760287 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:29.760254    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-pdw96"
Oct 31 07:38:29.923379 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:29.923347    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:29.923561 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:29.923537    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" podUID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" containerName="limitador" containerID="cri-o://3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451" gracePeriod=30
Oct 31 07:38:30.469577 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.469555    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:30.632201 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.632121    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\" (UniqueName: \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\") pod \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") "
Oct 31 07:38:30.632351 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.632205    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\" (UniqueName: \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\") pod \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\" (UID: \"bd1d8b9b-48ca-41bf-9749-3e3450e14143\") "
Oct 31 07:38:30.632640 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.632612    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file" pod "bd1d8b9b-48ca-41bf-9749-3e3450e14143" (UID: "bd1d8b9b-48ca-41bf-9749-3e3450e14143"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:38:30.634490 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.634471    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt" pod "bd1d8b9b-48ca-41bf-9749-3e3450e14143" (UID: "bd1d8b9b-48ca-41bf-9749-3e3450e14143"). InnerVolumeSpecName "kube-api-access-ltjzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:38:30.733993 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.733940    5872 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd1d8b9b-48ca-41bf-9749-3e3450e14143-config-file\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:38:30.733993 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.733993    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltjzt\" (UniqueName: \"kubernetes.io/projected/bd1d8b9b-48ca-41bf-9749-3e3450e14143-kube-api-access-ltjzt\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:38:30.812611 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.812574    5872 generic.go:356] "Generic (PLEG): container finished" podID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" containerID="3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451" exitCode=0
Oct 31 07:38:30.813059 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.812627    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"
Oct 31 07:38:30.813059 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.812668    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" event={"ID":"bd1d8b9b-48ca-41bf-9749-3e3450e14143","Type":"ContainerDied","Data":"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"}
Oct 31 07:38:30.813059 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.812731    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6gl9x" event={"ID":"bd1d8b9b-48ca-41bf-9749-3e3450e14143","Type":"ContainerDied","Data":"2afdb016c7e135a3fbd5f65f98f4920784303f0327b403cc42434a7572d8609a"}
Oct 31 07:38:30.813059 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.812756    5872 scope.go:122] "RemoveContainer" containerID="3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"
Oct 31 07:38:30.822223 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.822203    5872 scope.go:122] "RemoveContainer" containerID="3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"
Oct 31 07:38:30.822481 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:38:30.822461    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451\": container with ID starting with 3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451 not found: ID does not exist" containerID="3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"
Oct 31 07:38:30.822518 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.822492    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451"} err="failed to get container status \"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451\": rpc error: code = NotFound desc = could not find container \"3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451\": container with ID starting with 3dd815d2f4f12a5a972fdf1716163ae60b7ec079f22503cae7d99db389b55451 not found: ID does not exist"
Oct 31 07:38:30.975483 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.975456    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:30.979460 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:30.979437    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6gl9x"]
Oct 31 07:38:32.513414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:38:32.513368    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" path="/var/lib/kubelet/pods/bd1d8b9b-48ca-41bf-9749-3e3450e14143/volumes"
Oct 31 07:38:40.526780 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:38:40.526743    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:39:10.527586 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:39:10.527506    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:39:32.119332 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.119294    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"]
Oct 31 07:39:32.119962 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.119943    5872 cpu_manager.go:414] "containerMap: removing container" podUID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" containerName="limitador"
Oct 31 07:39:32.120037 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.119982    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" containerName="limitador"
Oct 31 07:39:32.120079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.120065    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd1d8b9b-48ca-41bf-9749-3e3450e14143" containerName="limitador"
Oct 31 07:39:32.122959 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.122945    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.226981 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.226937    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"]
Oct 31 07:39:32.254214 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254186    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254222    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254362 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254258    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254442 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254389    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254442 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254423    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254539 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254446    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmgw\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-kube-api-access-hkmgw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.254539 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.254523    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355066 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355032    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355082    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355113    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355140    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmgw\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-kube-api-access-hkmgw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355170    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355222    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355500 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355258    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.355925 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.355901    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.357510 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.357483    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.357680 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.357655    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.357818 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.357799    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.357928 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.357907    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.411728 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.411704    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.412048 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.412026    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmgw\" (UniqueName: \"kubernetes.io/projected/db395804-feb8-4f46-a0ea-6af7ddd7cd4b-kube-api-access-hkmgw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwm9t\" (UID: \"db395804-feb8-4f46-a0ea-6af7ddd7cd4b\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.434290 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.434270    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:32.853942 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.853918    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"]
Oct 31 07:39:32.856176 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:39:32.856153    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb395804_feb8_4f46_a0ea_6af7ddd7cd4b.slice/crio-2392c4d3cf0abfb4d0401270cff00a8ccefe14c307be3ff5a51ce049eff2cef5 WatchSource:0}: Error finding container 2392c4d3cf0abfb4d0401270cff00a8ccefe14c307be3ff5a51ce049eff2cef5: Status 404 returned error can't find the container with id 2392c4d3cf0abfb4d0401270cff00a8ccefe14c307be3ff5a51ce049eff2cef5
Oct 31 07:39:32.858181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.858147    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:39:32.858285 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:32.858222    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:39:33.125466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.125370    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t" event={"ID":"db395804-feb8-4f46-a0ea-6af7ddd7cd4b","Type":"ContainerStarted","Data":"0b6d2723eeba38cd4143f55c3efd8e3c81e90bbf553e0ee59f08a923718f7026"}
Oct 31 07:39:33.125466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.125433    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:33.125466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.125453    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t" event={"ID":"db395804-feb8-4f46-a0ea-6af7ddd7cd4b","Type":"ContainerStarted","Data":"2392c4d3cf0abfb4d0401270cff00a8ccefe14c307be3ff5a51ce049eff2cef5"}
Oct 31 07:39:33.127418 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.127382    5872 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mwm9t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:39:33.127572 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.127445    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t" podUID="db395804-feb8-4f46-a0ea-6af7ddd7cd4b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:39:33.269523 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:33.269469    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t" podStartSLOduration=1.269455442 podStartE2EDuration="1.269455442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:33.267578789 +0000 UTC m=+582.879788532" watchObservedRunningTime="2026-10-31 07:39:33.269455442 +0000 UTC m=+582.881665183"
Oct 31 07:39:34.138531 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:34.138495    5872 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mwm9t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:39:34.138907 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:34.138556    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t" podUID="db395804-feb8-4f46-a0ea-6af7ddd7cd4b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:39:37.138245 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.138215    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwm9t"
Oct 31 07:39:37.356168 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.356137    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:39:37.356365 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.356344    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerName="discovery" containerID="cri-o://a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705" gracePeriod=30
Oct 31 07:39:37.605422 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.605391    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:39:37.704664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704580    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.704664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704613    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.704664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704631    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.704664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704649    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.705009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704687    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.705009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704727    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.705009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.704748    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\") pod \"ee55f599-5881-44a6-8e91-f8d97fe88163\" (UID: \"ee55f599-5881-44a6-8e91-f8d97fe88163\") "
Oct 31 07:39:37.705247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.705201    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:39:37.707250 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707206    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:39:37.707250 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707217    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:39:37.707392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707332    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:39:37.707392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707358    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:39:37.707466 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707403    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:39:37.707517 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.707503    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v" pod "ee55f599-5881-44a6-8e91-f8d97fe88163" (UID: "ee55f599-5881-44a6-8e91-f8d97fe88163"). InnerVolumeSpecName "kube-api-access-8mj6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:39:37.806479 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806448    5872 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee55f599-5881-44a6-8e91-f8d97fe88163-local-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806479 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806472    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806479 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806483    5872 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-kubeconfig\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806699 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806493    5872 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-cacerts\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806699 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806502    5872 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-ca-configmap\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806699 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806513    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mj6v\" (UniqueName: \"kubernetes.io/projected/ee55f599-5881-44a6-8e91-f8d97fe88163-kube-api-access-8mj6v\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:37.806699 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:37.806523    5872 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee55f599-5881-44a6-8e91-f8d97fe88163-istio-csr-dns-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:39:38.156900 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.156813    5872 generic.go:356] "Generic (PLEG): container finished" podID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerID="a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705" exitCode=0
Oct 31 07:39:38.156900 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.156865    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"
Oct 31 07:39:38.157353 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.156901    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" event={"ID":"ee55f599-5881-44a6-8e91-f8d97fe88163","Type":"ContainerDied","Data":"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"}
Oct 31 07:39:38.157353 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.156954    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6" event={"ID":"ee55f599-5881-44a6-8e91-f8d97fe88163","Type":"ContainerDied","Data":"b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022"}
Oct 31 07:39:38.157353 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.157003    5872 scope.go:122] "RemoveContainer" containerID="a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"
Oct 31 07:39:38.166127 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:39:38.165025    5872 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55f599_5881_44a6_8e91_f8d97fe88163.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55f599_5881_44a6_8e91_f8d97fe88163.slice/crio-b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022\": RecentStats: unable to find data in memory cache]"
Oct 31 07:39:38.166127 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:39:38.165314    5872 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55f599_5881_44a6_8e91_f8d97fe88163.slice/crio-b928ab3914f45a69977e27ec7fba9c5d42fb745b06e3dab494c2c493ac70e022\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55f599_5881_44a6_8e91_f8d97fe88163.slice\": RecentStats: unable to find data in memory cache]"
Oct 31 07:39:38.166736 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.166718    5872 scope.go:122] "RemoveContainer" containerID="a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"
Oct 31 07:39:38.167069 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:39:38.167042    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705\": container with ID starting with a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705 not found: ID does not exist" containerID="a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"
Oct 31 07:39:38.167152 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.167076    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705"} err="failed to get container status \"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705\": rpc error: code = NotFound desc = could not find container \"a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705\": container with ID starting with a007aa76c2e7b93907bdf6c1ce781895f36713c175d94a9c54fefe31a6b66705 not found: ID does not exist"
Oct 31 07:39:38.322682 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.322654    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:39:38.372507 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.372471    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-77mz6"]
Oct 31 07:39:38.508310 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:38.508279    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" path="/var/lib/kubelet/pods/ee55f599-5881-44a6-8e91-f8d97fe88163/volumes"
Oct 31 07:39:40.528094 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:39:40.528061    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:39:44.844533 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.844503    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:39:44.844913 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.844896    5872 cpu_manager.go:414] "containerMap: removing container" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerName="discovery"
Oct 31 07:39:44.844952 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.844915    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerName="discovery"
Oct 31 07:39:44.845091 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.845078    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee55f599-5881-44a6-8e91-f8d97fe88163" containerName="discovery"
Oct 31 07:39:44.849408 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.849393    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:44.954370 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.954338    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 31 07:39:44.954586 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.954357    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Oct 31 07:39:44.954697 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.954399    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 31 07:39:44.954697 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.954474    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-vh6vh\""
Oct 31 07:39:44.956386 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.956364    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:39:44.967273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.967246    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:44.967429 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:44.967301    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675pd\" (UniqueName: \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.068772 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.068734    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.068942 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.068783    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675pd\" (UniqueName: \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.071176 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.071150    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.125162 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.125088    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-675pd\" (UniqueName: \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\") pod \"kserve-controller-manager-76d8b77fbb-74sl8\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") " pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.161954 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.161917    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:45.532263 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.532230    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:39:45.535046 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:39:45.535013    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7352aa_28b6_48e2_ae8b_b3a7c0deae58.slice/crio-5b6ff4568ef440f46eb0d84ed7b34e712fd765e901470a4683bf6318eb320551 WatchSource:0}: Error finding container 5b6ff4568ef440f46eb0d84ed7b34e712fd765e901470a4683bf6318eb320551: Status 404 returned error can't find the container with id 5b6ff4568ef440f46eb0d84ed7b34e712fd765e901470a4683bf6318eb320551
Oct 31 07:39:45.536456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:45.536437    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:39:46.200316 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:46.200285    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" event={"ID":"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58","Type":"ContainerStarted","Data":"5b6ff4568ef440f46eb0d84ed7b34e712fd765e901470a4683bf6318eb320551"}
Oct 31 07:39:50.577097 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:50.577069    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:39:50.577557 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:50.577534    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:39:50.594260 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:50.594241    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:39:50.594470 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:50.594454    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:39:52.241226 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:52.241192    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" event={"ID":"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58","Type":"ContainerStarted","Data":"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"}
Oct 31 07:39:52.241599 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:52.241360    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:39:52.354843 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:39:52.354740    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" podStartSLOduration=1.887381202 podStartE2EDuration="8.354726948s" totalImagesPullingTime="6.467345746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:52.353285324 +0000 UTC m=+601.965495067" watchObservedRunningTime="2026-10-31 07:39:52.354726948 +0000 UTC m=+601.966936721"
Oct 31 07:40:10.528025 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:40:10.527988    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:40:23.250528 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:23.250499    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:40:40.526485 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:40:40.526414    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:40:46.740743 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.740712    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:40:46.741340 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.740899    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" podUID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" containerName="manager" containerID="cri-o://2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587" gracePeriod=10
Oct 31 07:40:46.764171 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.764131    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-njr94"]
Oct 31 07:40:46.768803 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.768784    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.852828 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.852739    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-njr94"]
Oct 31 07:40:46.874602 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.874560    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-cert\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.874754 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.874729    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwrrx\" (UniqueName: \"kubernetes.io/projected/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-kube-api-access-zwrrx\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.976002 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.975952    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwrrx\" (UniqueName: \"kubernetes.io/projected/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-kube-api-access-zwrrx\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.976147 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.976019    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-cert\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.978294 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.978271    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-cert\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:46.981253 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:46.981235    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:40:47.032361 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.032317    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwrrx\" (UniqueName: \"kubernetes.io/projected/fd5365c7-9390-481d-a8e7-dbf8d76e32cf-kube-api-access-zwrrx\") pod \"kserve-controller-manager-76d8b77fbb-njr94\" (UID: \"fd5365c7-9390-481d-a8e7-dbf8d76e32cf\") " pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:47.077208 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.077187    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\" (UniqueName: \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\") pod \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") "
Oct 31 07:40:47.077311 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.077287    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\" (UniqueName: \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\") pod \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\" (UID: \"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58\") "
Oct 31 07:40:47.079229 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.079208    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd" pod "7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" (UID: "7d7352aa-28b6-48e2-ae8b-b3a7c0deae58"). InnerVolumeSpecName "kube-api-access-675pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:40:47.079315 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.079229    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert" pod "7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" (UID: "7d7352aa-28b6-48e2-ae8b-b3a7c0deae58"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:40:47.120280 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.120256    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:47.179455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.179425    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-675pd\" (UniqueName: \"kubernetes.io/projected/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-kube-api-access-675pd\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:40:47.179560 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.179462    5872 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:40:47.489250 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.489228    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-njr94"]
Oct 31 07:40:47.491383 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:40:47.491356    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5365c7_9390_481d_a8e7_dbf8d76e32cf.slice/crio-a66afb64385d85d1ffceda30c0a1b80a3d47ccd6262deaefddb6f5670c906dbd WatchSource:0}: Error finding container a66afb64385d85d1ffceda30c0a1b80a3d47ccd6262deaefddb6f5670c906dbd: Status 404 returned error can't find the container with id a66afb64385d85d1ffceda30c0a1b80a3d47ccd6262deaefddb6f5670c906dbd
Oct 31 07:40:47.516594 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.516567    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94" event={"ID":"fd5365c7-9390-481d-a8e7-dbf8d76e32cf","Type":"ContainerStarted","Data":"a66afb64385d85d1ffceda30c0a1b80a3d47ccd6262deaefddb6f5670c906dbd"}
Oct 31 07:40:47.517746 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.517718    5872 generic.go:356] "Generic (PLEG): container finished" podID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" containerID="2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587" exitCode=0
Oct 31 07:40:47.517845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.517759    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8"
Oct 31 07:40:47.517845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.517765    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" event={"ID":"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58","Type":"ContainerDied","Data":"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"}
Oct 31 07:40:47.517845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.517808    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-74sl8" event={"ID":"7d7352aa-28b6-48e2-ae8b-b3a7c0deae58","Type":"ContainerDied","Data":"5b6ff4568ef440f46eb0d84ed7b34e712fd765e901470a4683bf6318eb320551"}
Oct 31 07:40:47.517845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.517831    5872 scope.go:122] "RemoveContainer" containerID="2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"
Oct 31 07:40:47.529079 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.529050    5872 scope.go:122] "RemoveContainer" containerID="2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"
Oct 31 07:40:47.529444 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:40:47.529419    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587\": container with ID starting with 2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587 not found: ID does not exist" containerID="2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"
Oct 31 07:40:47.529522 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.529455    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587"} err="failed to get container status \"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587\": rpc error: code = NotFound desc = could not find container \"2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587\": container with ID starting with 2380c6d25c3729f07ccc96bd2bd41b979832d563273f93d965acf3f8f5d98587 not found: ID does not exist"
Oct 31 07:40:47.679349 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.679324    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:40:47.683154 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:47.683133    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-74sl8"]
Oct 31 07:40:48.507698 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:48.507667    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" path="/var/lib/kubelet/pods/7d7352aa-28b6-48e2-ae8b-b3a7c0deae58/volumes"
Oct 31 07:40:48.524360 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:48.524328    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94" event={"ID":"fd5365c7-9390-481d-a8e7-dbf8d76e32cf","Type":"ContainerStarted","Data":"197b80ed4455f7c8ea62f0a6b1502854640d2824f61d3cbc53a798107140ed7a"}
Oct 31 07:40:48.524481 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:48.524457    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:40:48.639160 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:40:48.639060    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94" podStartSLOduration=1.7815973779999998 podStartE2EDuration="2.639046695s" totalImagesPullingTime="857.449317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:48.637014245 +0000 UTC m=+658.249223986" watchObservedRunningTime="2026-10-31 07:40:48.639046695 +0000 UTC m=+658.251256436"
Oct 31 07:41:10.527072 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:41:10.527037    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:41:19.534516 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:19.534483    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-76d8b77fbb-njr94"
Oct 31 07:41:21.654920 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.654889    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-56ddc4c448-zz6zl"]
Oct 31 07:41:21.655297 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.655272    5872 cpu_manager.go:414] "containerMap: removing container" podUID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" containerName="manager"
Oct 31 07:41:21.655297 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.655284    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" containerName="manager"
Oct 31 07:41:21.655371 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.655364    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d7352aa-28b6-48e2-ae8b-b3a7c0deae58" containerName="manager"
Oct 31 07:41:21.658733 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.658713    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.742909 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.742869    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Oct 31 07:41:21.759546 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.759520    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dce2abd4-4b63-451e-8df8-3d02573efe67-tls-certs\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.759707 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.759589    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ww6f\" (UniqueName: \"kubernetes.io/projected/dce2abd4-4b63-451e-8df8-3d02573efe67-kube-api-access-2ww6f\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.765666 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.765648    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-6pmgg\""
Oct 31 07:41:21.767808 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.767781    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-zz6zl"]
Oct 31 07:41:21.860649 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.860614    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ww6f\" (UniqueName: \"kubernetes.io/projected/dce2abd4-4b63-451e-8df8-3d02573efe67-kube-api-access-2ww6f\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.860811 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.860699    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dce2abd4-4b63-451e-8df8-3d02573efe67-tls-certs\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.863098 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.863073    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dce2abd4-4b63-451e-8df8-3d02573efe67-tls-certs\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.917522 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.917494    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ww6f\" (UniqueName: \"kubernetes.io/projected/dce2abd4-4b63-451e-8df8-3d02573efe67-kube-api-access-2ww6f\") pod \"model-serving-api-56ddc4c448-zz6zl\" (UID: \"dce2abd4-4b63-451e-8df8-3d02573efe67\") " pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:21.973770 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:21.973741    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:22.343828 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:22.343671    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-zz6zl"]
Oct 31 07:41:22.346203 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:41:22.346178    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce2abd4_4b63_451e_8df8_3d02573efe67.slice/crio-d3a4c9120bd96d78f9d6eb9ac985fdcd1c347810b005135b0e816a42b6d4240b WatchSource:0}: Error finding container d3a4c9120bd96d78f9d6eb9ac985fdcd1c347810b005135b0e816a42b6d4240b: Status 404 returned error can't find the container with id d3a4c9120bd96d78f9d6eb9ac985fdcd1c347810b005135b0e816a42b6d4240b
Oct 31 07:41:22.696260 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:22.696230    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-zz6zl" event={"ID":"dce2abd4-4b63-451e-8df8-3d02573efe67","Type":"ContainerStarted","Data":"d3a4c9120bd96d78f9d6eb9ac985fdcd1c347810b005135b0e816a42b6d4240b"}
Oct 31 07:41:24.708895 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:24.708858    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-zz6zl" event={"ID":"dce2abd4-4b63-451e-8df8-3d02573efe67","Type":"ContainerStarted","Data":"b120c1f6ed1aafd773d4edf0c61796475f2c55fb61000f038cc6b6037a35fa91"}
Oct 31 07:41:24.709393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:24.709012    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:24.823457 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:24.823402    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/model-serving-api-56ddc4c448-zz6zl" podStartSLOduration=2.172482095 podStartE2EDuration="3.823386678s" totalImagesPullingTime="1.650904583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:24.82231545 +0000 UTC m=+694.434525193" watchObservedRunningTime="2026-10-31 07:41:24.823386678 +0000 UTC m=+694.435596420"
Oct 31 07:41:35.718262 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:41:35.718225    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-56ddc4c448-zz6zl"
Oct 31 07:41:40.526774 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:41:40.526738    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:42:10.527454 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:42:10.527381    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:42:40.528575 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:42:40.528537    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:43:10.527724 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:43:10.527687    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:43:40.527371 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:43:40.527288    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:44:10.529044 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:44:10.529007    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:44:40.527857 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:44:40.527817    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:44:50.615674 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:44:50.615643    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:44:50.619408 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:44:50.619383    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:44:50.633493 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:44:50.633472    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:44:50.636853 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:44:50.636835    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:45:10.527424 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:45:10.527343    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:45:40.527810 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:45:40.527766    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:46:10.528076 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:46:10.528040    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:46:40.526776 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:46:40.526740    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:46:45.320150 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.320117    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:46:45.323533 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.323513    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.380129 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.380103    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"kube-root-ca.crt\""
Oct 31 07:46:45.381109 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.381086    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"openshift-service-ca.crt\""
Oct 31 07:46:45.382455 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.382433    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:46:45.392527 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.392502    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.392661 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.392640    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnc4\" (UniqueName: \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.430038 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.430019    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-epp-sa-dockercfg-58gqv\""
Oct 31 07:46:45.430161 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.430099    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Oct 31 07:46:45.430161 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.430154    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"default-dockercfg-9jmwn\""
Oct 31 07:46:45.493033 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.493006    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnc4\" (UniqueName: \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.493164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.493064    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.495417 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.495399    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.549650 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.549625    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnc4\" (UniqueName: \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:45.636685 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:45.636620    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:46.006774 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:46.006749    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:46:46.009164 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:46:46.009135    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde5abad_1231_46eb_8cc4_ce2e302e2a79.slice/crio-f5d04fd8e1d9d1a00895f3f289dc1222af9abf79f62b9ca1511a4f68fb0a1ac7 WatchSource:0}: Error finding container f5d04fd8e1d9d1a00895f3f289dc1222af9abf79f62b9ca1511a4f68fb0a1ac7: Status 404 returned error can't find the container with id f5d04fd8e1d9d1a00895f3f289dc1222af9abf79f62b9ca1511a4f68fb0a1ac7
Oct 31 07:46:46.011183 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:46.011164    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:46:46.293592 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:46.293510    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" event={"ID":"fde5abad-1231-46eb-8cc4-ce2e302e2a79","Type":"ContainerStarted","Data":"f5d04fd8e1d9d1a00895f3f289dc1222af9abf79f62b9ca1511a4f68fb0a1ac7"}
Oct 31 07:46:48.312985 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:48.312863    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" event={"ID":"fde5abad-1231-46eb-8cc4-ce2e302e2a79","Type":"ContainerStarted","Data":"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"}
Oct 31 07:46:48.313367 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:48.313083    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:46:48.426185 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:48.426133    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podStartSLOduration=1.398625249 podStartE2EDuration="3.426119132s" totalImagesPullingTime="2.027493883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:46:48.425136883 +0000 UTC m=+1018.037346626" watchObservedRunningTime="2026-10-31 07:46:48.426119132 +0000 UTC m=+1018.038328874"
Oct 31 07:46:58.362616 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.362525    5872 generic.go:356] "Generic (PLEG): container finished" podID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerID="68760d836d42e10aabbd4d812bd9c1334959e8bc6e7d4de736cf70128beb2158" exitCode=0
Oct 31 07:46:58.362616 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.362599    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerDied","Data":"68760d836d42e10aabbd4d812bd9c1334959e8bc6e7d4de736cf70128beb2158"}
Oct 31 07:46:58.363090 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.362921    5872 scope.go:122] "RemoveContainer" containerID="68760d836d42e10aabbd4d812bd9c1334959e8bc6e7d4de736cf70128beb2158"
Oct 31 07:46:58.363942 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.363916    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:46:58.364014 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.364001    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:46:58.364055 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:58.364038    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:46:59.373233 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:59.373190    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerStarted","Data":"c01603d3cd6278e109349aed7a1a0ca453e63ae5ec9747ac205f81bd7e8e81bf"}
Oct 31 07:46:59.537578 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:59.537541    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:46:59.537756 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:59.537695    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:46:59.537807 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:46:59.537748    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:00.538094 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:00.538060    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:47:00.538495 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:00.538117    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:01.537881 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:01.537846    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:47:01.538073 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:01.537898    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:02.537985 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:02.537934    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:47:02.538456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:02.538027    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:03.537898 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:03.537855    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:47:03.538088 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:03.537928    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:04.537266 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:04.537231    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 31 07:47:04.537439 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:04.537290    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 31 07:47:05.542155 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:05.542117    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:47:05.542618 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:05.542438    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:47:05.543261 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:05.543244    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 07:47:10.527896 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:47:10.527864    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:47:19.319310 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:19.319280    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:47:25.870517 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:25.870486    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:47:29.319796 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:29.319760    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:47:39.319906 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:39.319872    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:47:40.527760 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:47:40.527722    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:47:40.890039 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:40.889919    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" containerID="cri-o://1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0" gracePeriod=45
Oct 31 07:47:49.319494 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:49.319457    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:47:49.319927 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:49.319565    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:47:59.320019 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:47:59.319911    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:48:09.319300 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:09.319256    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:48:10.527842 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:48:10.527806    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:48:11.134509 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.134489    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:48:11.261975 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.261934    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\" (UniqueName: \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\") pod \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") "
Oct 31 07:48:11.262126 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.261983    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\" (UniqueName: \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\") pod \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\" (UID: \"fde5abad-1231-46eb-8cc4-ce2e302e2a79\") "
Oct 31 07:48:11.264038 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.264011    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs" pod "fde5abad-1231-46eb-8cc4-ce2e302e2a79" (UID: "fde5abad-1231-46eb-8cc4-ce2e302e2a79"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:48:11.264142 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.264076    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4" pod "fde5abad-1231-46eb-8cc4-ce2e302e2a79" (UID: "fde5abad-1231-46eb-8cc4-ce2e302e2a79"). InnerVolumeSpecName "kube-api-access-rjnc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:48:11.363385 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.363360    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde5abad-1231-46eb-8cc4-ce2e302e2a79-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:48:11.363385 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.363383    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjnc4\" (UniqueName: \"kubernetes.io/projected/fde5abad-1231-46eb-8cc4-ce2e302e2a79-kube-api-access-rjnc4\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:48:11.741442 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.741407    5872 generic.go:356] "Generic (PLEG): container finished" podID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerID="1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0" exitCode=0
Oct 31 07:48:11.741934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.741478    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"
Oct 31 07:48:11.741934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.741484    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" event={"ID":"fde5abad-1231-46eb-8cc4-ce2e302e2a79","Type":"ContainerDied","Data":"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"}
Oct 31 07:48:11.741934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.741537    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6" event={"ID":"fde5abad-1231-46eb-8cc4-ce2e302e2a79","Type":"ContainerDied","Data":"f5d04fd8e1d9d1a00895f3f289dc1222af9abf79f62b9ca1511a4f68fb0a1ac7"}
Oct 31 07:48:11.741934 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.741558    5872 scope.go:122] "RemoveContainer" containerID="1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"
Oct 31 07:48:11.750360 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.750343    5872 scope.go:122] "RemoveContainer" containerID="1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"
Oct 31 07:48:11.750585 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:48:11.750569    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0\": container with ID starting with 1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0 not found: ID does not exist" containerID="1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"
Oct 31 07:48:11.750627 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.750592    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0"} err="failed to get container status \"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0\": rpc error: code = NotFound desc = could not find container \"1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0\": container with ID starting with 1b231062bb390fa9e685c12660b91abef427e33d6019b591aa49e5f51116e1b0 not found: ID does not exist"
Oct 31 07:48:11.903677 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.903649    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:48:11.953396 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:11.953356    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bcglg6"]
Oct 31 07:48:12.280361 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.280331    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:48:12.280726 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.280714    5872 cpu_manager.go:414] "containerMap: removing container" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main"
Oct 31 07:48:12.280769 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.280728    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main"
Oct 31 07:48:12.280815 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.280798    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" containerName="main"
Oct 31 07:48:12.285020 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.285001    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.339939 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.339907    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"kube-root-ca.crt\""
Oct 31 07:48:12.340144 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.340109    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"default-dockercfg-mfsf4\""
Oct 31 07:48:12.340228 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.340158    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"test-cpu-accelerator-preset-ser-afc820a4-epp-sa-dockercfg-x22hf\""
Oct 31 07:48:12.340228 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.340202    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"test-cb25a14c9ba423627edeb5388343bd353-kserve-self-signed-certs\""
Oct 31 07:48:12.340559 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.340538    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"openshift-service-ca.crt\""
Oct 31 07:48:12.342287 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.342262    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:48:12.372500 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.372472    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg52x\" (UniqueName: \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.372622 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.372512    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.473929 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.473891    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg52x\" (UniqueName: \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.474136 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.473941    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.476559 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.476526    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.508292 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.508260    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fde5abad-1231-46eb-8cc4-ce2e302e2a79" path="/var/lib/kubelet/pods/fde5abad-1231-46eb-8cc4-ce2e302e2a79/volumes"
Oct 31 07:48:12.531023 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.530946    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg52x\" (UniqueName: \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.597697 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.597660    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:12.968770 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:12.968744    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:48:12.970898 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:48:12.970863    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33115eeb_c913_4f78_a6ec_0e8f10b3ee39.slice/crio-07983c6842b03376f6f9f306dfef22de620110a33dad4e62d3452d68b2af22e9 WatchSource:0}: Error finding container 07983c6842b03376f6f9f306dfef22de620110a33dad4e62d3452d68b2af22e9: Status 404 returned error can't find the container with id 07983c6842b03376f6f9f306dfef22de620110a33dad4e62d3452d68b2af22e9
Oct 31 07:48:13.753315 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:13.753280    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" event={"ID":"33115eeb-c913-4f78-a6ec-0e8f10b3ee39","Type":"ContainerStarted","Data":"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"}
Oct 31 07:48:13.753476 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:13.753332    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" event={"ID":"33115eeb-c913-4f78-a6ec-0e8f10b3ee39","Type":"ContainerStarted","Data":"07983c6842b03376f6f9f306dfef22de620110a33dad4e62d3452d68b2af22e9"}
Oct 31 07:48:13.753476 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:13.753368    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:48:13.868187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:13.868140    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podStartSLOduration=1.868125888 podStartE2EDuration="1.868125888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:48:13.866090965 +0000 UTC m=+1103.478300707" watchObservedRunningTime="2026-10-31 07:48:13.868125888 +0000 UTC m=+1103.480335629"
Oct 31 07:48:35.638907 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.638870    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 07:48:35.642393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.642377    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704602 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704570    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704731 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704617    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704731 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704641    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704816 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704748    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704816 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704775    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704816 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704792    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rscv\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.704922 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704893    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.705003 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.704952    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.705052 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.705031    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.805657 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.805620    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.805904 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.805879    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806037 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.805934    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806037 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.805991    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806037 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806022    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806198 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806046    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806198 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806070    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rscv\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806198 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806123    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806358 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806231    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806415 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806369    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806415 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806397    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806529 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806495    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806589 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806570    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.806734 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.806715    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.808487 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.808467    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.808588 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.808571    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.849796 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.849774    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 07:48:35.862873 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.862849    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.863102 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.863083    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rscv\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:35.955597 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:35.955564    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:36.377310 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.377233    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 07:48:36.419511 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:48:36.419478    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d6e528_2a8e_485b_9805_0a8666d5172d.slice/crio-601dee8a9bcb4bc6f0264f706335695927e9989c1d96c444999ab6370b0be98f WatchSource:0}: Error finding container 601dee8a9bcb4bc6f0264f706335695927e9989c1d96c444999ab6370b0be98f: Status 404 returned error can't find the container with id 601dee8a9bcb4bc6f0264f706335695927e9989c1d96c444999ab6370b0be98f
Oct 31 07:48:36.421444 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.421408    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:48:36.421533 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.421476    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:48:36.421533 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.421506    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:48:36.885138 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.885101    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" event={"ID":"49d6e528-2a8e-485b-9805-0a8666d5172d","Type":"ContainerStarted","Data":"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"}
Oct 31 07:48:36.885536 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.885156    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" event={"ID":"49d6e528-2a8e-485b-9805-0a8666d5172d","Type":"ContainerStarted","Data":"601dee8a9bcb4bc6f0264f706335695927e9989c1d96c444999ab6370b0be98f"}
Oct 31 07:48:36.972106 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:36.972061    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:37.071991 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:37.071058    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podStartSLOduration=2.071037753 podStartE2EDuration="2.071037753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:48:37.069254241 +0000 UTC m=+1126.681463983" watchObservedRunningTime="2026-10-31 07:48:37.071037753 +0000 UTC m=+1126.683247497"
Oct 31 07:48:37.973061 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:37.973026    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 07:48:37.973483 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:37.973081    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 07:48:38.967990 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:38.967357    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 07:48:38.967990 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:38.967420    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 07:48:39.972153 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:39.972109    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 07:48:39.972578 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:39.972186    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 07:48:40.529471 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:48:40.529435    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:48:40.972084 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:40.972050    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 07:48:40.972305 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:40.972115    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 07:48:41.968993 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:41.966422    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 07:48:41.968993 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:41.966497    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 07:48:42.959427 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:42.959397    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:42.959886 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:42.959677    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:42.960387 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:42.960367    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 07:48:44.760519 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:48:44.760486    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:49:10.528111 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:49:10.528077    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:49:39.958779 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:39.958748    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:49:40.527162 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:49:40.527129    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:49:44.760397 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:44.760358    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:49:50.653906 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:50.653880    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:49:50.658523 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:50.658504    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:49:50.670881 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:50.670861    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:49:50.675018 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:50.674998    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:49:54.760081 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:54.760045    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:49:54.978503 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:49:54.978442    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" containerID="cri-o://e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3" gracePeriod=45
Oct 31 07:50:04.760376 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:04.760333    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:50:04.760908 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:04.760458    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:50:10.527227 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:50:10.527191    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:50:14.759880 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:14.759844    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:50:24.759957 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:24.759914    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:50:25.230375 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.230350    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:50:25.276115 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.276093    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\" (UniqueName: \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\") pod \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") "
Oct 31 07:50:25.276237 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.276185    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\" (UniqueName: \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\") pod \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\" (UID: \"33115eeb-c913-4f78-a6ec-0e8f10b3ee39\") "
Oct 31 07:50:25.278181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.278153    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs" pod "33115eeb-c913-4f78-a6ec-0e8f10b3ee39" (UID: "33115eeb-c913-4f78-a6ec-0e8f10b3ee39"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:50:25.278303 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.278282    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x" pod "33115eeb-c913-4f78-a6ec-0e8f10b3ee39" (UID: "33115eeb-c913-4f78-a6ec-0e8f10b3ee39"). InnerVolumeSpecName "kube-api-access-tg52x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:50:25.377066 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.377002    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:50:25.377066 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.377026    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg52x\" (UniqueName: \"kubernetes.io/projected/33115eeb-c913-4f78-a6ec-0e8f10b3ee39-kube-api-access-tg52x\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:50:25.430307 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.430274    5872 generic.go:356] "Generic (PLEG): container finished" podID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerID="e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3" exitCode=0
Oct 31 07:50:25.430449 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.430334    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"
Oct 31 07:50:25.430449 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.430354    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" event={"ID":"33115eeb-c913-4f78-a6ec-0e8f10b3ee39","Type":"ContainerDied","Data":"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"}
Oct 31 07:50:25.430449 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.430431    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q" event={"ID":"33115eeb-c913-4f78-a6ec-0e8f10b3ee39","Type":"ContainerDied","Data":"07983c6842b03376f6f9f306dfef22de620110a33dad4e62d3452d68b2af22e9"}
Oct 31 07:50:25.430603 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.430455    5872 scope.go:122] "RemoveContainer" containerID="e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"
Oct 31 07:50:25.440377 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.440359    5872 scope.go:122] "RemoveContainer" containerID="e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"
Oct 31 07:50:25.440621 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:50:25.440604    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3\": container with ID starting with e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3 not found: ID does not exist" containerID="e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"
Oct 31 07:50:25.440664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.440628    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3"} err="failed to get container status \"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3\": rpc error: code = NotFound desc = could not find container \"e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3\": container with ID starting with e9b335207589871d3a7724f26ca1d9b21793912695c7f81088e8b7dfec63f4f3 not found: ID does not exist"
Oct 31 07:50:25.592636 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.592605    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:50:25.596223 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:25.596189    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-scheljr8q"]
Oct 31 07:50:26.507762 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:26.507721    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" path="/var/lib/kubelet/pods/33115eeb-c913-4f78-a6ec-0e8f10b3ee39/volumes"
Oct 31 07:50:30.571720 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.571682    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:50:30.572256 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.572240    5872 cpu_manager.go:414] "containerMap: removing container" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main"
Oct 31 07:50:30.572300 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.572259    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main"
Oct 31 07:50:30.572376 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.572365    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="33115eeb-c913-4f78-a6ec-0e8f10b3ee39" containerName="main"
Oct 31 07:50:30.576689 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.576670    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.622365 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.622334    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d94p4\" (UniqueName: \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.622365 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.622377    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.630947 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.630919    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"openshift-service-ca.crt\""
Oct 31 07:50:30.652860 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.652835    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"kube-root-ca.crt\""
Oct 31 07:50:30.680604 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.680579    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"default-dockercfg-fz4zj\""
Oct 31 07:50:30.680604 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.680576    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-swp4k\""
Oct 31 07:50:30.680728 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.680630    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Oct 31 07:50:30.682666 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.682648    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:50:30.723894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.723531    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d94p4\" (UniqueName: \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.723894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.723592    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.727368 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.727337    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.782551 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.782515    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d94p4\" (UniqueName: \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:30.888924 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:30.888845    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:31.258815 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:31.258710    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:50:31.261285 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:50:31.261255    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481b22c6_5edd_452a_802d_92e19bc96fed.slice/crio-91ce23adc4320af6bbba1a62262c0976c6fce219eee249d1310127715bc3ae29 WatchSource:0}: Error finding container 91ce23adc4320af6bbba1a62262c0976c6fce219eee249d1310127715bc3ae29: Status 404 returned error can't find the container with id 91ce23adc4320af6bbba1a62262c0976c6fce219eee249d1310127715bc3ae29
Oct 31 07:50:31.463880 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:31.463838    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" event={"ID":"481b22c6-5edd-452a-802d-92e19bc96fed","Type":"ContainerStarted","Data":"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"}
Oct 31 07:50:31.464077 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:31.463910    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:50:31.464077 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:31.463932    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" event={"ID":"481b22c6-5edd-452a-802d-92e19bc96fed","Type":"ContainerStarted","Data":"91ce23adc4320af6bbba1a62262c0976c6fce219eee249d1310127715bc3ae29"}
Oct 31 07:50:31.578395 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:31.578290    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podStartSLOduration=1.5782763530000001 podStartE2EDuration="1.578276353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:50:31.576732971 +0000 UTC m=+1241.188942712" watchObservedRunningTime="2026-10-31 07:50:31.578276353 +0000 UTC m=+1241.190486095"
Oct 31 07:50:40.526679 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:50:40.526643    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:50:51.699532 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.699460    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"]
Oct 31 07:50:51.704105 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.704087    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755038 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755013    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755136 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755050    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755136 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755069    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755241 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755220    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755282 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755250    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755344 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755330    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755377 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755352    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3fbeb3-09d0-4095-8006-407a691b559c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755411 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755388    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bnl\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-kube-api-access-64bnl\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.755444 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.755410    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856147 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856113    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856147 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856154    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856170    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856216    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856232    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856286    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856310    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3fbeb3-09d0-4095-8006-407a691b559c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856335    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bnl\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-kube-api-access-64bnl\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856393 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856362    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856780 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856630    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856780 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856666    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.856780 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.856684    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.857118 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.857095    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3fbeb3-09d0-4095-8006-407a691b559c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.857292 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.857275    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.858619 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.858600    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.858874 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.858856    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.904801 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.904768    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"]
Oct 31 07:50:51.915855 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.915822    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:51.916040 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:51.915888    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bnl\" (UniqueName: \"kubernetes.io/projected/5a3fbeb3-09d0-4095-8006-407a691b559c-kube-api-access-64bnl\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n\" (UID: \"5a3fbeb3-09d0-4095-8006-407a691b559c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:52.017342 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.017263    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:52.441860 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.441830    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"]
Oct 31 07:50:52.445521 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:50:52.445482    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3fbeb3_09d0_4095_8006_407a691b559c.slice/crio-42239a7347a8ea45d53744e52770f0e375d731515f9b6720b6254f620a730778 WatchSource:0}: Error finding container 42239a7347a8ea45d53744e52770f0e375d731515f9b6720b6254f620a730778: Status 404 returned error can't find the container with id 42239a7347a8ea45d53744e52770f0e375d731515f9b6720b6254f620a730778
Oct 31 07:50:52.450682 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.450651    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:50:52.450754 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.450722    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:50:52.450754 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.450752    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:50:52.605281 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.605246    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" event={"ID":"5a3fbeb3-09d0-4095-8006-407a691b559c","Type":"ContainerStarted","Data":"b9d6c3e2832ee0d0cf365833ca10de53daaa7f7bcb8214ad010c62f6ac3a72d7"}
Oct 31 07:50:52.605456 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.605300    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" event={"ID":"5a3fbeb3-09d0-4095-8006-407a691b559c","Type":"ContainerStarted","Data":"42239a7347a8ea45d53744e52770f0e375d731515f9b6720b6254f620a730778"}
Oct 31 07:50:52.724297 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:52.724183    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podStartSLOduration=1.724167874 podStartE2EDuration="1.724167874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:50:52.721266402 +0000 UTC m=+1262.333476148" watchObservedRunningTime="2026-10-31 07:50:52.724167874 +0000 UTC m=+1262.336377615"
Oct 31 07:50:53.018086 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:53.018010    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:53.019389 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:53.019365    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:53.019513 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:53.019417    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:54.018641 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:54.018611    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:54.019054 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:54.018665    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:55.018634 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:55.018600    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:55.018863 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:55.018660    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:56.018247 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:56.018212    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:56.018424 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:56.018269    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:57.018181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:57.018145    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:57.018585 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:57.018196    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:58.018385 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:58.018342    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 31 07:50:58.018871 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:58.018420    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n" podUID="5a3fbeb3-09d0-4095-8006-407a691b559c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 31 07:50:59.021440 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:59.021358    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:59.021894 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:59.021713    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:50:59.022309 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:50:59.022290    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n"
Oct 31 07:51:02.496917 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:02.496888    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:51:08.443886 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:08.443849    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:51:10.527379 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:51:10.527343    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:51:12.497610 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:12.497569    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:51:22.497298 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:22.497258    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:51:23.464661 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:23.464609    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" containerID="cri-o://9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95" gracePeriod=45
Oct 31 07:51:32.497009 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:32.496951    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:51:32.497464 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:32.497126    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:51:40.527296 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:51:40.527257    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:51:42.497423 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:42.497381    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:51:52.496788 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:52.496751    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:51:53.723432 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.723405    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:51:53.841512 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.841441    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\" (UniqueName: \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\") pod \"481b22c6-5edd-452a-802d-92e19bc96fed\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") "
Oct 31 07:51:53.841667 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.841558    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\" (UniqueName: \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\") pod \"481b22c6-5edd-452a-802d-92e19bc96fed\" (UID: \"481b22c6-5edd-452a-802d-92e19bc96fed\") "
Oct 31 07:51:53.843679 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.843653    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4" pod "481b22c6-5edd-452a-802d-92e19bc96fed" (UID: "481b22c6-5edd-452a-802d-92e19bc96fed"). InnerVolumeSpecName "kube-api-access-d94p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:51:53.843810 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.843751    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs" pod "481b22c6-5edd-452a-802d-92e19bc96fed" (UID: "481b22c6-5edd-452a-802d-92e19bc96fed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:51:53.942258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942229    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d94p4\" (UniqueName: \"kubernetes.io/projected/481b22c6-5edd-452a-802d-92e19bc96fed-kube-api-access-d94p4\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:51:53.942258 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942253    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481b22c6-5edd-452a-802d-92e19bc96fed-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:51:53.942441 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942265    5872 generic.go:356] "Generic (PLEG): container finished" podID="481b22c6-5edd-452a-802d-92e19bc96fed" containerID="9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95" exitCode=0
Oct 31 07:51:53.942441 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942309    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"
Oct 31 07:51:53.942441 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942339    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" event={"ID":"481b22c6-5edd-452a-802d-92e19bc96fed","Type":"ContainerDied","Data":"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"}
Oct 31 07:51:53.942441 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942386    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z" event={"ID":"481b22c6-5edd-452a-802d-92e19bc96fed","Type":"ContainerDied","Data":"91ce23adc4320af6bbba1a62262c0976c6fce219eee249d1310127715bc3ae29"}
Oct 31 07:51:53.942441 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.942410    5872 scope.go:122] "RemoveContainer" containerID="9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"
Oct 31 07:51:53.951529 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.951512    5872 scope.go:122] "RemoveContainer" containerID="9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"
Oct 31 07:51:53.951807 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:51:53.951781    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95\": container with ID starting with 9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95 not found: ID does not exist" containerID="9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"
Oct 31 07:51:53.951881 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:53.951812    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95"} err="failed to get container status \"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95\": rpc error: code = NotFound desc = could not find container \"9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95\": container with ID starting with 9334c824b8ef72db2cb9ac9d862dd3f5f71f103abe1827675a9484abaca07a95 not found: ID does not exist"
Oct 31 07:51:54.104688 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:54.104621    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:51:54.107913 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:54.107890    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheqm57z"]
Oct 31 07:51:54.508326 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:51:54.508297    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" path="/var/lib/kubelet/pods/481b22c6-5edd-452a-802d-92e19bc96fed/volumes"
Oct 31 07:52:10.528562 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:52:10.528523    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:52:40.528247 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:52:40.528209    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:52:47.764080 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.764042    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:52:47.764498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.764471    5872 cpu_manager.go:414] "containerMap: removing container" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main"
Oct 31 07:52:47.764498 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.764491    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main"
Oct 31 07:52:47.764569 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.764556    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="481b22c6-5edd-452a-802d-92e19bc96fed" containerName="main"
Oct 31 07:52:47.767596 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.767577    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.817628 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.817593    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zgzl\" (UniqueName: \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.817786 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.817642    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.823521 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.823496    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"openshift-service-ca.crt\""
Oct 31 07:52:47.823711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.823681    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"kube-root-ca.crt\""
Oct 31 07:52:47.844933 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.844904    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:52:47.873241 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.873210    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"default-dockercfg-kq8rt\""
Oct 31 07:52:47.873392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.873275    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-kserve-self-signed-certs\""
Oct 31 07:52:47.873392 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.873297    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-epp-sa-dockercfg-527wn\""
Oct 31 07:52:47.919725 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.919683    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zgzl\" (UniqueName: \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.919725 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.919727    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.925862 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.925829    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:47.986581 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:47.986554    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zgzl\" (UniqueName: \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:48.080611 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:48.080516    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:48.455340 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:48.455319    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:52:48.457766 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:52:48.457735    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd291afc_5f55_4c35_ac00_7d811df4c10a.slice/crio-3bb4ddbe2c7c4efae265c3a95c89a5c14e9a5c60d1afd38e335817788091c58c WatchSource:0}: Error finding container 3bb4ddbe2c7c4efae265c3a95c89a5c14e9a5c60d1afd38e335817788091c58c: Status 404 returned error can't find the container with id 3bb4ddbe2c7c4efae265c3a95c89a5c14e9a5c60d1afd38e335817788091c58c
Oct 31 07:52:49.222842 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:49.222804    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" event={"ID":"bd291afc-5f55-4c35-ac00-7d811df4c10a","Type":"ContainerStarted","Data":"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"}
Oct 31 07:52:49.223294 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:49.222861    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" event={"ID":"bd291afc-5f55-4c35-ac00-7d811df4c10a","Type":"ContainerStarted","Data":"3bb4ddbe2c7c4efae265c3a95c89a5c14e9a5c60d1afd38e335817788091c58c"}
Oct 31 07:52:49.223294 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:49.222928    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:52:49.338274 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:52:49.338215    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podStartSLOduration=2.338198588 podStartE2EDuration="2.338198588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:52:49.337615233 +0000 UTC m=+1378.949824974" watchObservedRunningTime="2026-10-31 07:52:49.338198588 +0000 UTC m=+1378.950408332"
Oct 31 07:53:10.527193 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:53:10.527156    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:53:20.230244 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:53:20.230211    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:53:30.885279 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:53:30.885247    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:53:40.229515 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:53:40.229473    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:53:40.530259 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:53:40.530176    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:53:45.912711 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:53:45.912672    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main" containerID="cri-o://eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0" gracePeriod=45
Oct 31 07:53:50.229434 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:53:50.229387    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:54:00.230026 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:00.229909    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:54:00.230439 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:00.230081    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:54:10.229585 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:10.229541    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:54:10.526892 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:54:10.526814    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:54:16.154753 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.154728    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:54:16.168845 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.168826    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\" (UniqueName: \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\") pod \"bd291afc-5f55-4c35-ac00-7d811df4c10a\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") "
Oct 31 07:54:16.168937 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.168876    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\") pod \"bd291afc-5f55-4c35-ac00-7d811df4c10a\" (UID: \"bd291afc-5f55-4c35-ac00-7d811df4c10a\") "
Oct 31 07:54:16.170887 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.170837    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs" pod "bd291afc-5f55-4c35-ac00-7d811df4c10a" (UID: "bd291afc-5f55-4c35-ac00-7d811df4c10a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:54:16.170979 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.170938    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl" pod "bd291afc-5f55-4c35-ac00-7d811df4c10a" (UID: "bd291afc-5f55-4c35-ac00-7d811df4c10a"). InnerVolumeSpecName "kube-api-access-9zgzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:54:16.269407 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.269378    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zgzl\" (UniqueName: \"kubernetes.io/projected/bd291afc-5f55-4c35-ac00-7d811df4c10a-kube-api-access-9zgzl\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:54:16.269407 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.269404    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd291afc-5f55-4c35-ac00-7d811df4c10a-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:54:16.724038 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.723999    5872 generic.go:356] "Generic (PLEG): container finished" podID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerID="eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0" exitCode=0
Oct 31 07:54:16.724194 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.724065    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" event={"ID":"bd291afc-5f55-4c35-ac00-7d811df4c10a","Type":"ContainerDied","Data":"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"}
Oct 31 07:54:16.724194 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.724096    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"
Oct 31 07:54:16.724194 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.724108    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz" event={"ID":"bd291afc-5f55-4c35-ac00-7d811df4c10a","Type":"ContainerDied","Data":"3bb4ddbe2c7c4efae265c3a95c89a5c14e9a5c60d1afd38e335817788091c58c"}
Oct 31 07:54:16.724194 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.724131    5872 scope.go:122] "RemoveContainer" containerID="eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"
Oct 31 07:54:16.732876 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.732845    5872 scope.go:122] "RemoveContainer" containerID="eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"
Oct 31 07:54:16.733142 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:54:16.733121    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0\": container with ID starting with eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0 not found: ID does not exist" containerID="eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"
Oct 31 07:54:16.733191 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.733150    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0"} err="failed to get container status \"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0\": rpc error: code = NotFound desc = could not find container \"eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0\": container with ID starting with eea2d3065d2286a5f77f547141f10397ad57f2a5f40fd8b040fda0abe1f557f0 not found: ID does not exist"
Oct 31 07:54:16.886536 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.886455    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:54:16.936739 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:16.936708    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-fk9gz"]
Oct 31 07:54:18.508330 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:18.508292    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" path="/var/lib/kubelet/pods/bd291afc-5f55-4c35-ac00-7d811df4c10a/volumes"
Oct 31 07:54:20.480773 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.480704    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:54:20.481535 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.481512    5872 cpu_manager.go:414] "containerMap: removing container" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main"
Oct 31 07:54:20.481595 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.481538    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main"
Oct 31 07:54:20.481640 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.481623    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd291afc-5f55-4c35-ac00-7d811df4c10a" containerName="main"
Oct 31 07:54:20.485942 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.485925    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.501759 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.501733    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhs9r\" (UniqueName: \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.501859 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.501763    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.542003 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.541956    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:54:20.563187 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.563165    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Oct 31 07:54:20.589383 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.589358    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Oct 31 07:54:20.589383 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.589381    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-kv29k\""
Oct 31 07:54:20.589637 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.589620    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-5cq6q\""
Oct 31 07:54:20.589722 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.589707    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Oct 31 07:54:20.602261 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.602239    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhs9r\" (UniqueName: \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.602331 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.602267    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.604678 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.604654    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.659398 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.659357    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhs9r\" (UniqueName: \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:20.798562 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:20.798470    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:21.168381 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:21.168357    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:54:21.170596 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:54:21.170568    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66b8db4_7fc7_4360_88ce_523d222345a5.slice/crio-bc3510201e0d4f6319ad0c00415ae992c08880e720ab81630cb0b22d0bc0b6d9 WatchSource:0}: Error finding container bc3510201e0d4f6319ad0c00415ae992c08880e720ab81630cb0b22d0bc0b6d9: Status 404 returned error can't find the container with id bc3510201e0d4f6319ad0c00415ae992c08880e720ab81630cb0b22d0bc0b6d9
Oct 31 07:54:21.751692 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:21.751652    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" event={"ID":"c66b8db4-7fc7-4360-88ce-523d222345a5","Type":"ContainerStarted","Data":"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"}
Oct 31 07:54:21.752107 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:21.751717    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" event={"ID":"c66b8db4-7fc7-4360-88ce-523d222345a5","Type":"ContainerStarted","Data":"bc3510201e0d4f6319ad0c00415ae992c08880e720ab81630cb0b22d0bc0b6d9"}
Oct 31 07:54:21.752107 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:21.751744    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:21.868406 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:21.868346    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podStartSLOduration=1.868331976 podStartE2EDuration="1.868331976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:54:21.867528031 +0000 UTC m=+1471.479737777" watchObservedRunningTime="2026-10-31 07:54:21.868331976 +0000 UTC m=+1471.480541719"
Oct 31 07:54:30.142445 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.142408    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:54:30.146273 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.146250    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.203959 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.203931    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:54:30.232025 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.232002    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"openshift-service-ca.crt\""
Oct 31 07:54:30.232025 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.232015    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"kube-root-ca.crt\""
Oct 31 07:54:30.247299 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.247271    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksvl\" (UniqueName: \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.247506 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.247320    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.251352 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.251326    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"default-dockercfg-bchcn\""
Oct 31 07:54:30.251463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.251376    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-kserve-self-signed-certs\""
Oct 31 07:54:30.251463 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.251413    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-epp-sa-dockercfg-m7jlz\""
Oct 31 07:54:30.348760 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.348725    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pksvl\" (UniqueName: \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.348940 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.348780    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.351373 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.351347    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.406505 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.406430    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pksvl\" (UniqueName: \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.459900 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.459871    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:30.831097 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.831055    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:54:30.833567 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:54:30.833536    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4465ff24_7bd4_4f14_bfad_66d640cc7275.slice/crio-769ecf16148e4d5440c61a6487d647b7df0c8a924070ca425daa2f2b3dbc3280 WatchSource:0}: Error finding container 769ecf16148e4d5440c61a6487d647b7df0c8a924070ca425daa2f2b3dbc3280: Status 404 returned error can't find the container with id 769ecf16148e4d5440c61a6487d647b7df0c8a924070ca425daa2f2b3dbc3280
Oct 31 07:54:30.855093 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:30.855068    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" event={"ID":"4465ff24-7bd4-4f14-bfad-66d640cc7275","Type":"ContainerStarted","Data":"769ecf16148e4d5440c61a6487d647b7df0c8a924070ca425daa2f2b3dbc3280"}
Oct 31 07:54:31.862103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:31.862058    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" event={"ID":"4465ff24-7bd4-4f14-bfad-66d640cc7275","Type":"ContainerStarted","Data":"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"}
Oct 31 07:54:31.862572 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:31.862157    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:54:31.976192 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:31.976138    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podStartSLOduration=1.976125384 podStartE2EDuration="1.976125384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:54:31.974708558 +0000 UTC m=+1481.586918311" watchObservedRunningTime="2026-10-31 07:54:31.976125384 +0000 UTC m=+1481.588335125"
Oct 31 07:54:40.528260 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:54:40.528220    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:54:50.690691 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:50.690665    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:54:50.696877 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:50.696855    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:54:50.712381 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:50.712359    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:54:50.717684 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:50.717668    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:54:52.758213 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:52.758183    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:54:58.878832 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:54:58.878792    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:55:02.758813 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:02.758769    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:02.869218 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:02.869189    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:55:10.528329 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:55:10.528290    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:55:12.758574 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:12.758535    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:13.389566 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:13.389529    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:55:13.898635 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:13.898594    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" containerID="cri-o://3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68" gracePeriod=45
Oct 31 07:55:22.757621 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:22.757585    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:22.758047 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:22.757718    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:55:22.868851 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:22.868818    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:28.409707 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:28.409642    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main" containerID="cri-o://255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5" gracePeriod=45
Oct 31 07:55:32.758518 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:32.758425    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:32.869354 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:32.869314    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:40.528992 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:55:40.528942    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:55:42.758164 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:42.758131    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:42.869747 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:42.869711    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:42.869913 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:42.869805    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:55:44.151507 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.151483    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:55:44.250409 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.250372    5872 generic.go:356] "Generic (PLEG): container finished" podID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerID="3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68" exitCode=0
Oct 31 07:55:44.250554 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.250419    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"
Oct 31 07:55:44.250554 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.250422    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" event={"ID":"c66b8db4-7fc7-4360-88ce-523d222345a5","Type":"ContainerDied","Data":"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"}
Oct 31 07:55:44.250632 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.250581    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct" event={"ID":"c66b8db4-7fc7-4360-88ce-523d222345a5","Type":"ContainerDied","Data":"bc3510201e0d4f6319ad0c00415ae992c08880e720ab81630cb0b22d0bc0b6d9"}
Oct 31 07:55:44.250632 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.250618    5872 scope.go:122] "RemoveContainer" containerID="3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"
Oct 31 07:55:44.259326 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.259308    5872 scope.go:122] "RemoveContainer" containerID="3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"
Oct 31 07:55:44.259584 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:55:44.259555    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68\": container with ID starting with 3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68 not found: ID does not exist" containerID="3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"
Oct 31 07:55:44.259655 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.259591    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68"} err="failed to get container status \"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68\": rpc error: code = NotFound desc = could not find container \"3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68\": container with ID starting with 3f3cf4eff429126f570f470ba6600bdc617f1dba6c05e287d0c3ac4cee8dbd68 not found: ID does not exist"
Oct 31 07:55:44.270371 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.270349    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\" (UniqueName: \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\") pod \"c66b8db4-7fc7-4360-88ce-523d222345a5\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") "
Oct 31 07:55:44.270525 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.270504    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\" (UniqueName: \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\") pod \"c66b8db4-7fc7-4360-88ce-523d222345a5\" (UID: \"c66b8db4-7fc7-4360-88ce-523d222345a5\") "
Oct 31 07:55:44.273577 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.273552    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs" pod "c66b8db4-7fc7-4360-88ce-523d222345a5" (UID: "c66b8db4-7fc7-4360-88ce-523d222345a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:55:44.273760 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.273735    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r" pod "c66b8db4-7fc7-4360-88ce-523d222345a5" (UID: "c66b8db4-7fc7-4360-88ce-523d222345a5"). InnerVolumeSpecName "kube-api-access-dhs9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:55:44.371978 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.371945    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhs9r\" (UniqueName: \"kubernetes.io/projected/c66b8db4-7fc7-4360-88ce-523d222345a5-kube-api-access-dhs9r\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:55:44.372112 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.371994    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c66b8db4-7fc7-4360-88ce-523d222345a5-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:55:44.663935 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.663902    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:55:44.713458 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:44.713429    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bqvfct"]
Oct 31 07:55:46.508628 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:46.508594    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" path="/var/lib/kubelet/pods/c66b8db4-7fc7-4360-88ce-523d222345a5/volumes"
Oct 31 07:55:52.869648 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:52.869612    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:55:58.654167 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.654138    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:55:58.689175 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.689119    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\" (UniqueName: \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\") pod \"4465ff24-7bd4-4f14-bfad-66d640cc7275\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") "
Oct 31 07:55:58.689175 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.689170    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\") pod \"4465ff24-7bd4-4f14-bfad-66d640cc7275\" (UID: \"4465ff24-7bd4-4f14-bfad-66d640cc7275\") "
Oct 31 07:55:58.691195 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.691164    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl" pod "4465ff24-7bd4-4f14-bfad-66d640cc7275" (UID: "4465ff24-7bd4-4f14-bfad-66d640cc7275"). InnerVolumeSpecName "kube-api-access-pksvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:55:58.691302 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.691247    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs" pod "4465ff24-7bd4-4f14-bfad-66d640cc7275" (UID: "4465ff24-7bd4-4f14-bfad-66d640cc7275"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:55:58.790411 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.790385    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pksvl\" (UniqueName: \"kubernetes.io/projected/4465ff24-7bd4-4f14-bfad-66d640cc7275-kube-api-access-pksvl\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:55:58.790411 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:58.790411    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4465ff24-7bd4-4f14-bfad-66d640cc7275-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:55:59.330044 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.330009    5872 generic.go:356] "Generic (PLEG): container finished" podID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerID="255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5" exitCode=0
Oct 31 07:55:59.330219 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.330057    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"
Oct 31 07:55:59.330219 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.330080    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" event={"ID":"4465ff24-7bd4-4f14-bfad-66d640cc7275","Type":"ContainerDied","Data":"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"}
Oct 31 07:55:59.330219 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.330120    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz" event={"ID":"4465ff24-7bd4-4f14-bfad-66d640cc7275","Type":"ContainerDied","Data":"769ecf16148e4d5440c61a6487d647b7df0c8a924070ca425daa2f2b3dbc3280"}
Oct 31 07:55:59.330219 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.330141    5872 scope.go:122] "RemoveContainer" containerID="255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"
Oct 31 07:55:59.339481 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.339460    5872 scope.go:122] "RemoveContainer" containerID="255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"
Oct 31 07:55:59.339743 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:55:59.339720    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5\": container with ID starting with 255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5 not found: ID does not exist" containerID="255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"
Oct 31 07:55:59.339839 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.339749    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5"} err="failed to get container status \"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5\": rpc error: code = NotFound desc = could not find container \"255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5\": container with ID starting with 255c4d1ef9ba908edf0b8d8e1bfe9a3ec5b1513fc5b13e64472ceadc765271c5 not found: ID does not exist"
Oct 31 07:55:59.495898 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.495839    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:55:59.498006 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:55:59.497982    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-94llz"]
Oct 31 07:56:00.509108 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:56:00.509076    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" path="/var/lib/kubelet/pods/4465ff24-7bd4-4f14-bfad-66d640cc7275/volumes"
Oct 31 07:56:10.530866 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:56:10.530825    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:56:40.527735 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:56:40.527691    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:57:10.527340 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:57:10.527298    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:57:22.138527 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.138489    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.138874    5872 cpu_manager.go:414] "containerMap: removing container" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main"
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.138885    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main"
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.138904    5872 cpu_manager.go:414] "containerMap: removing container" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main"
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.138909    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main"
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.139007    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="4465ff24-7bd4-4f14-bfad-66d640cc7275" containerName="main"
Oct 31 07:57:22.140950 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.139019    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="c66b8db4-7fc7-4360-88ce-523d222345a5" containerName="main"
Oct 31 07:57:22.141887 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.141872    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222452 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222420    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222452 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222458    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222649 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222476    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222649 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222544    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222649 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222592    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222782 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222656    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222782 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222691    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222782 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222775    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzwl6\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.222890 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.222846    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.225983 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.225946    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"openshift-service-ca.crt\""
Oct 31 07:57:22.226128 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.226018    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"openshift-gw-ca-root-cert\""
Oct 31 07:57:22.226128 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.226046    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"router-gateway-1-openshift-default-dockercfg-tlj57\""
Oct 31 07:57:22.226128 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.226065    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"kube-root-ca.crt\""
Oct 31 07:57:22.247023 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.246990    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:22.323948 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.323909    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.323948 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.323949    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324207 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324091    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324207 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324138    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324207 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324185    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324207 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324202    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324218    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324238    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzwl6\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324414 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324372    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324573 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324447    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324573 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324480    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324664 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324558    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.324702 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.324670    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.325035 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.325015    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.326582 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.326561    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.326773 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.326756    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.381242 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.381210    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.381479 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.381456    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzwl6\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\") pod \"router-gateway-1-openshift-default-5b86887945-842s6\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.455280 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.455244    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:22.881153 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.881124    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:22.883293 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:57:22.883264    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66599dd3_1ef3_4b28_bfb1_9e9a274e0e4c.slice/crio-e1dbe57c269c9ab67afec35d60645798e90079fcc30f1e2800f138c87392d6b1 WatchSource:0}: Error finding container e1dbe57c269c9ab67afec35d60645798e90079fcc30f1e2800f138c87392d6b1: Status 404 returned error can't find the container with id e1dbe57c269c9ab67afec35d60645798e90079fcc30f1e2800f138c87392d6b1
Oct 31 07:57:22.885408 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.885379    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:57:22.885491 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.885437    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:57:22.885491 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:22.885471    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 07:57:23.746893 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:23.746855    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" event={"ID":"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c","Type":"ContainerStarted","Data":"8ea7b52d4ee11565679f4e78e5d175be0efdd5342857faa1806e5f47091d8f42"}
Oct 31 07:57:23.747304 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:23.746916    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" event={"ID":"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c","Type":"ContainerStarted","Data":"e1dbe57c269c9ab67afec35d60645798e90079fcc30f1e2800f138c87392d6b1"}
Oct 31 07:57:23.962335 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:23.962281    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" podStartSLOduration=1.9622666899999999 podStartE2EDuration="1.96226669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:57:23.91204207 +0000 UTC m=+1653.524251806" watchObservedRunningTime="2026-10-31 07:57:23.96226669 +0000 UTC m=+1653.574476503"
Oct 31 07:57:24.455919 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:24.455879    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:24.460597 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:24.460570    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:24.751670 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:24.751578    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:24.752411 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:24.752396    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:38.721642 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:38.721599    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:38.722085 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:38.721882    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerName="istio-proxy" containerID="cri-o://8ea7b52d4ee11565679f4e78e5d175be0efdd5342857faa1806e5f47091d8f42" gracePeriod=30
Oct 31 07:57:39.754199 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:39.754153    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:57:40.527503 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:57:40.527470    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:57:43.851552 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:43.851525    5872 generic.go:356] "Generic (PLEG): container finished" podID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerID="8ea7b52d4ee11565679f4e78e5d175be0efdd5342857faa1806e5f47091d8f42" exitCode=0
Oct 31 07:57:43.851921 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:43.851578    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" event={"ID":"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c","Type":"ContainerDied","Data":"8ea7b52d4ee11565679f4e78e5d175be0efdd5342857faa1806e5f47091d8f42"}
Oct 31 07:57:43.982933 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:43.982873    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:44.017560 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017533    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017657 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017566    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017657 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017596    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017657 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017625    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017657 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017653    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017841 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017678    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017841 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017699    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017841 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017789    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.017841 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017818    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\") pod \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\" (UID: \"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c\") "
Oct 31 07:57:44.018073 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017815    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:57:44.018073 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.017895    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:57:44.018181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.018090    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:57:44.018181 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.018161    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.018266 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.018182    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.018266 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.018160    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:57:44.018266 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.018173    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:57:44.019884 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.019858    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:57:44.019996 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.019895    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:57:44.020044 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.019990    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "kube-api-access-xzwl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:57:44.020044 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.019995    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token" pod "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" (UID: "66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:57:44.118887 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118849    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.118887 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118877    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzwl6\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-kube-api-access-xzwl6\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.119103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118897    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.119103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118910    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.119103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118922    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.119103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118933    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.119103 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.118944    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:57:44.858204 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.858123    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"
Oct 31 07:57:44.858204 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.858144    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6" event={"ID":"66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c","Type":"ContainerDied","Data":"e1dbe57c269c9ab67afec35d60645798e90079fcc30f1e2800f138c87392d6b1"}
Oct 31 07:57:44.858682 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:44.858211    5872 scope.go:122] "RemoveContainer" containerID="8ea7b52d4ee11565679f4e78e5d175be0efdd5342857faa1806e5f47091d8f42"
Oct 31 07:57:45.072127 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:45.072089    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:45.122212 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:45.122129    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/router-gateway-1-openshift-default-5b86887945-842s6"]
Oct 31 07:57:46.510643 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:46.510598    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" path="/var/lib/kubelet/pods/66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c/volumes"
Oct 31 07:57:48.149133 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.149103    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 07:57:48.149546 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.149504    5872 cpu_manager.go:414] "containerMap: removing container" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerName="istio-proxy"
Oct 31 07:57:48.149613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.149547    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerName="istio-proxy"
Oct 31 07:57:48.149613 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.149609    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="66599dd3-1ef3-4b28-bfb1-9e9a274e0e4c" containerName="istio-proxy"
Oct 31 07:57:48.153935 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.153916    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.207848 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.207820    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"kube-root-ca.crt\""
Oct 31 07:57:48.239049 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.239016    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"openshift-service-ca.crt\""
Oct 31 07:57:48.257433 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.257406    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-epp-sa-dockercfg-hx852\""
Oct 31 07:57:48.257554 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.257488    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.257627 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.257610    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-kserve-self-signed-certs\""
Oct 31 07:57:48.257681 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.257610    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs8nf\" (UniqueName: \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.257874 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.257859    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"default-dockercfg-b9hzd\""
Oct 31 07:57:48.259348 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.259325    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 07:57:48.359104 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.359071    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.359281 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.359131    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs8nf\" (UniqueName: \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.361522 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.361499    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.415276 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.415245    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs8nf\" (UniqueName: \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.466107 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.466084    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:48.839162 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.839138    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 07:57:48.841800 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:57:48.841770    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0a97fd_d3eb_489d_b34f_1cf7791288f8.slice/crio-eae759c51937b0eae3a5a8a91b0960f9afea7e5da29a035e26fcc1d5c464006b WatchSource:0}: Error finding container eae759c51937b0eae3a5a8a91b0960f9afea7e5da29a035e26fcc1d5c464006b: Status 404 returned error can't find the container with id eae759c51937b0eae3a5a8a91b0960f9afea7e5da29a035e26fcc1d5c464006b
Oct 31 07:57:48.880126 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:48.880096    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" event={"ID":"fc0a97fd-d3eb-489d-b34f-1cf7791288f8","Type":"ContainerStarted","Data":"eae759c51937b0eae3a5a8a91b0960f9afea7e5da29a035e26fcc1d5c464006b"}
Oct 31 07:57:49.920519 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:49.920472    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" event={"ID":"fc0a97fd-d3eb-489d-b34f-1cf7791288f8","Type":"ContainerStarted","Data":"34c7ccf2747432a5b7a304b6df830f7248028dd899a0ebfe843dde9ecf5f976d"}
Oct 31 07:57:49.922196 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:49.922172    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:57:50.040749 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:57:50.040693    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podStartSLOduration=2.040679491 podStartE2EDuration="2.040679491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:57:50.039867377 +0000 UTC m=+1679.652077120" watchObservedRunningTime="2026-10-31 07:57:50.040679491 +0000 UTC m=+1679.652889234"
Oct 31 07:58:04.379534 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.379497    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:58:04.384488 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.384466    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.402901 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.402870    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.403063 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.402916    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghqf\" (UniqueName: \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.436731 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.436701    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"openshift-service-ca.crt\""
Oct 31 07:58:04.463884 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.463847    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Oct 31 07:58:04.463884 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.463857    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"kube-root-ca.crt\""
Oct 31 07:58:04.486490 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.486457    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-8v9s4\""
Oct 31 07:58:04.486702 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.486630    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"default-dockercfg-h92jf\""
Oct 31 07:58:04.488609 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.488582    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:58:04.503443 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.503414    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.503560 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.503465    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghqf\" (UniqueName: \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.506087 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.506068    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.560386 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.560351    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghqf\" (UniqueName: \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:04.698059 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:04.698031    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:05.070813 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:05.070786    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:58:05.073504 ip-10-0-140-145 kubenswrapper[5872]: W1031 07:58:05.073469    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1f7c87_6edc_4a88_99b0_3c4dfa23cc9f.slice/crio-e8d20accfcd3bc471e343aca1592aa9119ba3a25cb6fec12143fc2e52f114549 WatchSource:0}: Error finding container e8d20accfcd3bc471e343aca1592aa9119ba3a25cb6fec12143fc2e52f114549: Status 404 returned error can't find the container with id e8d20accfcd3bc471e343aca1592aa9119ba3a25cb6fec12143fc2e52f114549
Oct 31 07:58:06.016145 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:06.016107    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" event={"ID":"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f","Type":"ContainerStarted","Data":"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"}
Oct 31 07:58:06.016547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:06.016167    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" event={"ID":"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f","Type":"ContainerStarted","Data":"e8d20accfcd3bc471e343aca1592aa9119ba3a25cb6fec12143fc2e52f114549"}
Oct 31 07:58:06.016547 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:06.016189    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:06.132155 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:06.132102    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podStartSLOduration=2.132088161 podStartE2EDuration="2.132088161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:58:06.130585035 +0000 UTC m=+1695.742794779" watchObservedRunningTime="2026-10-31 07:58:06.132088161 +0000 UTC m=+1695.744297945"
Oct 31 07:58:10.528332 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:58:10.528296    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:58:21.934777 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:21.934741    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 07:58:37.023050 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:37.023013    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:58:40.528244 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:58:40.528202    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:58:43.534133 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:43.534091    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:58:47.023347 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:47.023308    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:58:57.023331 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:57.023289    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:58:58.557274 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:58:58.557226    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main" containerID="cri-o://02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57" gracePeriod=45
Oct 31 07:59:07.023014 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:07.022951    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:59:07.023470 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:07.023130    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:59:10.527932 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:59:10.527892    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:59:17.022475 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:17.022437    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:59:25.110207 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.109939    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb_5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f/main/0.log"
Oct 31 07:59:25.112385 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.112360    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:59:25.206574 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.206553    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\" (UniqueName: \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\") pod \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") "
Oct 31 07:59:25.206693 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.206639    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\") pod \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\" (UID: \"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f\") "
Oct 31 07:59:25.208741 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.208716    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs" pod "5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" (UID: "5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:59:25.208819 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.208718    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf" pod "5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" (UID: "5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f"). InnerVolumeSpecName "kube-api-access-lghqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:59:25.307985 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.307937    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lghqf\" (UniqueName: \"kubernetes.io/projected/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-kube-api-access-lghqf\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:59:25.307985 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.307983    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 07:59:25.440150 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440126    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb_5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f/main/0.log"
Oct 31 07:59:25.440283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440162    5872 generic.go:356] "Generic (PLEG): container finished" podID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerID="02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57" exitCode=1
Oct 31 07:59:25.440283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440193    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" event={"ID":"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f","Type":"ContainerDied","Data":"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"}
Oct 31 07:59:25.440283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440214    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"
Oct 31 07:59:25.440283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440234    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb" event={"ID":"5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f","Type":"ContainerDied","Data":"e8d20accfcd3bc471e343aca1592aa9119ba3a25cb6fec12143fc2e52f114549"}
Oct 31 07:59:25.440283 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.440260    5872 scope.go:122] "RemoveContainer" containerID="02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"
Oct 31 07:59:25.449947 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.449931    5872 scope.go:122] "RemoveContainer" containerID="02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"
Oct 31 07:59:25.450260 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:59:25.450239    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57\": container with ID starting with 02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57 not found: ID does not exist" containerID="02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"
Oct 31 07:59:25.450306 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.450269    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57"} err="failed to get container status \"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57\": rpc error: code = NotFound desc = could not find container \"02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57\": container with ID starting with 02a9e5b5eeb0d8ad6c067d9f24b0c4c0efbbe6c0c9f4b6a59c5b4350931edc57 not found: ID does not exist"
Oct 31 07:59:25.603018 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.602916    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:59:25.606703 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:25.606681    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6sctlb"]
Oct 31 07:59:26.508144 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:26.508113    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" path="/var/lib/kubelet/pods/5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f/volumes"
Oct 31 07:59:40.528711 ip-10-0-140-145 kubenswrapper[5872]: E1031 07:59:40.528673    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 07:59:49.688156 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:49.688120    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 07:59:50.731717 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:50.731685    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:59:50.738469 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:50.738444    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 07:59:50.752039 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:50.752020    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:59:50.758833 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:50.758817    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 07:59:51.934577 ip-10-0-140-145 kubenswrapper[5872]: I1031 07:59:51.934536    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:00:01.935343 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:01.935257    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:00:04.708197 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:04.708137    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" containerID="cri-o://34c7ccf2747432a5b7a304b6df830f7248028dd899a0ebfe843dde9ecf5f976d" gracePeriod=45
Oct 31 08:00:10.527419 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:00:10.527382    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:00:11.934566 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:11.934525    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:00:11.934947 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:11.934629    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 08:00:21.934826 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:21.934787    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:00:31.934957 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:31.934915    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:00:34.827902 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:34.827875    5872 generic.go:356] "Generic (PLEG): container finished" podID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerID="34c7ccf2747432a5b7a304b6df830f7248028dd899a0ebfe843dde9ecf5f976d" exitCode=0
Oct 31 08:00:34.828253 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:34.827954    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" event={"ID":"fc0a97fd-d3eb-489d-b34f-1cf7791288f8","Type":"ContainerDied","Data":"34c7ccf2747432a5b7a304b6df830f7248028dd899a0ebfe843dde9ecf5f976d"}
Oct 31 08:00:34.959504 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:34.959481    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 08:00:35.050706 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.050626    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\" (UniqueName: \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\") pod \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") "
Oct 31 08:00:35.050860 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.050726    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\") pod \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\" (UID: \"fc0a97fd-d3eb-489d-b34f-1cf7791288f8\") "
Oct 31 08:00:35.052877 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.052843    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs" pod "fc0a97fd-d3eb-489d-b34f-1cf7791288f8" (UID: "fc0a97fd-d3eb-489d-b34f-1cf7791288f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:00:35.052877 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.052864    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf" pod "fc0a97fd-d3eb-489d-b34f-1cf7791288f8" (UID: "fc0a97fd-d3eb-489d-b34f-1cf7791288f8"). InnerVolumeSpecName "kube-api-access-rs8nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:00:35.151835 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.151796    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs8nf\" (UniqueName: \"kubernetes.io/projected/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-kube-api-access-rs8nf\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:00:35.151835 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.151831    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0a97fd-d3eb-489d-b34f-1cf7791288f8-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:00:35.834408 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.834380    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"
Oct 31 08:00:35.834906 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.834412    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp" event={"ID":"fc0a97fd-d3eb-489d-b34f-1cf7791288f8","Type":"ContainerDied","Data":"eae759c51937b0eae3a5a8a91b0960f9afea7e5da29a035e26fcc1d5c464006b"}
Oct 31 08:00:35.834906 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.834479    5872 scope.go:122] "RemoveContainer" containerID="34c7ccf2747432a5b7a304b6df830f7248028dd899a0ebfe843dde9ecf5f976d"
Oct 31 08:00:35.998686 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:35.998652    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 08:00:36.050694 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:36.050650    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-6qmrp"]
Oct 31 08:00:36.509311 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:00:36.509277    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" path="/var/lib/kubelet/pods/fc0a97fd-d3eb-489d-b34f-1cf7791288f8/volumes"
Oct 31 08:00:40.527377 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:00:40.527342    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:01:10.526719 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:01:10.526682    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:01:12.979169 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979132    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:01:12.979556 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979525    5872 cpu_manager.go:414] "containerMap: removing container" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main"
Oct 31 08:01:12.979556 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979538    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main"
Oct 31 08:01:12.979556 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979546    5872 cpu_manager.go:414] "containerMap: removing container" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main"
Oct 31 08:01:12.979556 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979552    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main"
Oct 31 08:01:12.979737 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979703    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc0a97fd-d3eb-489d-b34f-1cf7791288f8" containerName="main"
Oct 31 08:01:12.979788 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.979761    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c1f7c87-6edc-4a88-99b0-3c4dfa23cc9f" containerName="main"
Oct 31 08:01:12.983052 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:12.983034    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.039516 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.039427    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:01:13.082358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.082332    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.082498 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.082369    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5bq9\" (UniqueName: \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.086765 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.086743    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"kube-root-ca.crt\""
Oct 31 08:01:13.086829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.086747    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Oct 31 08:01:13.086829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.086774    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-epp-sa-dockercfg-8d477\""
Oct 31 08:01:13.086910 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.086827    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"default-dockercfg-d8tqr\""
Oct 31 08:01:13.086910 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.086831    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"openshift-service-ca.crt\""
Oct 31 08:01:13.183992 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.183936    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.184183 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.184023    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5bq9\" (UniqueName: \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.186423 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.186402    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.240522 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.240455    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5bq9\" (UniqueName: \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.296401 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.296375    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:13.667305 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:13.667279    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:01:13.669939 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:01:13.669910    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7b54fd_6850_4716_9242_2ab8bf099a97.slice/crio-fbf2a3387fa86a15b2ceffb0e2cad12d0bbd9e4e71bb417c61cdf9cdffa03cfb WatchSource:0}: Error finding container fbf2a3387fa86a15b2ceffb0e2cad12d0bbd9e4e71bb417c61cdf9cdffa03cfb: Status 404 returned error can't find the container with id fbf2a3387fa86a15b2ceffb0e2cad12d0bbd9e4e71bb417c61cdf9cdffa03cfb
Oct 31 08:01:14.032040 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:14.031934    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" event={"ID":"8c7b54fd-6850-4716-9242-2ab8bf099a97","Type":"ContainerStarted","Data":"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"}
Oct 31 08:01:14.032040 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:14.032005    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" event={"ID":"8c7b54fd-6850-4716-9242-2ab8bf099a97","Type":"ContainerStarted","Data":"fbf2a3387fa86a15b2ceffb0e2cad12d0bbd9e4e71bb417c61cdf9cdffa03cfb"}
Oct 31 08:01:14.032449 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:14.032146    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:14.145644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:14.145588    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podStartSLOduration=2.145574491 podStartE2EDuration="2.145574491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:01:14.144665954 +0000 UTC m=+1883.756875696" watchObservedRunningTime="2026-10-31 08:01:14.145574491 +0000 UTC m=+1883.757784233"
Oct 31 08:01:40.528606 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:01:40.528570    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:01:45.038534 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:45.038505    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:01:55.416897 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:01:55.416859    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:02:05.039187 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:05.039142    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:02:10.436540 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:10.436471    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main" containerID="cri-o://6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5" gracePeriod=45
Oct 31 08:02:10.526635 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:02:10.526600    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:02:15.038393 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:15.038354    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:02:25.038199 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:25.038161    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:02:25.040595 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:25.038276    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:02:35.038381 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:35.038345    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:02:40.526998 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:02:40.526948    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:02:40.679218 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.679194    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:02:40.790497 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.790427    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\") pod \"8c7b54fd-6850-4716-9242-2ab8bf099a97\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") "
Oct 31 08:02:40.790628 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.790511    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\" (UniqueName: \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\") pod \"8c7b54fd-6850-4716-9242-2ab8bf099a97\" (UID: \"8c7b54fd-6850-4716-9242-2ab8bf099a97\") "
Oct 31 08:02:40.793021 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.792988    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9" pod "8c7b54fd-6850-4716-9242-2ab8bf099a97" (UID: "8c7b54fd-6850-4716-9242-2ab8bf099a97"). InnerVolumeSpecName "kube-api-access-h5bq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:02:40.793256 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.793237    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs" pod "8c7b54fd-6850-4716-9242-2ab8bf099a97" (UID: "8c7b54fd-6850-4716-9242-2ab8bf099a97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:02:40.891812 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.891780    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5bq9\" (UniqueName: \"kubernetes.io/projected/8c7b54fd-6850-4716-9242-2ab8bf099a97-kube-api-access-h5bq9\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:02:40.891812 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:40.891808    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7b54fd-6850-4716-9242-2ab8bf099a97-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:02:41.521897 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.521853    5872 generic.go:356] "Generic (PLEG): container finished" podID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerID="6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5" exitCode=0
Oct 31 08:02:41.522115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.521916    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"
Oct 31 08:02:41.522115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.521939    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" event={"ID":"8c7b54fd-6850-4716-9242-2ab8bf099a97","Type":"ContainerDied","Data":"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"}
Oct 31 08:02:41.522115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.522007    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb" event={"ID":"8c7b54fd-6850-4716-9242-2ab8bf099a97","Type":"ContainerDied","Data":"fbf2a3387fa86a15b2ceffb0e2cad12d0bbd9e4e71bb417c61cdf9cdffa03cfb"}
Oct 31 08:02:41.522115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.522022    5872 scope.go:122] "RemoveContainer" containerID="6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"
Oct 31 08:02:41.531424 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.531407    5872 scope.go:122] "RemoveContainer" containerID="6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"
Oct 31 08:02:41.531740 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:02:41.531713    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5\": container with ID starting with 6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5 not found: ID does not exist" containerID="6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"
Oct 31 08:02:41.531780 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.531739    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5"} err="failed to get container status \"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5\": rpc error: code = NotFound desc = could not find container \"6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5\": container with ID starting with 6953b94479ebf2e359787a81160fd76867beb688efd10cfa1503b6a4d85439c5 not found: ID does not exist"
Oct 31 08:02:41.685687 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.685645    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:02:41.735593 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:41.735555    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-697wqfb"]
Oct 31 08:02:42.508146 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:42.508113    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" path="/var/lib/kubelet/pods/8c7b54fd-6850-4716-9242-2ab8bf099a97/volumes"
Oct 31 08:02:52.790990 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.790936    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:02:52.791363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.791330    5872 cpu_manager.go:414] "containerMap: removing container" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main"
Oct 31 08:02:52.791363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.791342    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main"
Oct 31 08:02:52.791437 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.791414    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c7b54fd-6850-4716-9242-2ab8bf099a97" containerName="main"
Oct 31 08:02:52.795538 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.795517    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.852506 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.852475    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:02:52.893029 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.893004    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"openshift-service-ca.crt\""
Oct 31 08:02:52.896411 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896387    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.896522 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896429    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkjn\" (UniqueName: \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.896522 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896447    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.896620 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896576    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.896620 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896610    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.896705 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.896633    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.899533 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.899508    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"default-dockercfg-5gg8s\""
Oct 31 08:02:52.899637 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.899588    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Oct 31 08:02:52.899637 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.899588    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"kube-root-ca.crt\""
Oct 31 08:02:52.997713 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997683    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.997874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997722    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkjn\" (UniqueName: \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.997874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997741    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.997874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997781    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.997874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997813    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.997874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.997837    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.998227 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.998204    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.998284 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.998230    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:52.998320 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:52.998273    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:53.000181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.000154    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:53.000390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.000375    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:53.054207 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.054141    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkjn\" (UniqueName: \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:53.108073 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.108040    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:02:53.204719 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.204683    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:02:53.208463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.208443    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.264644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.264612    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-epp-sa-dockercfg-dh7m4\""
Oct 31 08:02:53.266733 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.266706    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:02:53.301693 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.301667    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrw4c\" (UniqueName: \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.301820 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.301731    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.402653 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.402570    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.402813 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.402663    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrw4c\" (UniqueName: \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.405093 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.405069    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.458878 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.458851    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrw4c\" (UniqueName: \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedccw58\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.494227 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.494192    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:02:53.497289 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:02:53.497258    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d151715_d546_4102_862b_acabfd8ae128.slice/crio-1bb110c1f19b95e1c67190690edd5ad0d5c6a103f499e2b627f4759cc2546bc5 WatchSource:0}: Error finding container 1bb110c1f19b95e1c67190690edd5ad0d5c6a103f499e2b627f4759cc2546bc5: Status 404 returned error can't find the container with id 1bb110c1f19b95e1c67190690edd5ad0d5c6a103f499e2b627f4759cc2546bc5
Oct 31 08:02:53.499122 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.499107    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 08:02:53.521177 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.521155    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:53.584587 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.584547    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" event={"ID":"2d151715-d546-4102-862b-acabfd8ae128","Type":"ContainerStarted","Data":"1bb110c1f19b95e1c67190690edd5ad0d5c6a103f499e2b627f4759cc2546bc5"}
Oct 31 08:02:53.889610 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:53.889582    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:02:53.892149 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:02:53.892123    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38842c17_1cbd_4918_8ad7_a9c497d2c2e0.slice/crio-86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353 WatchSource:0}: Error finding container 86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353: Status 404 returned error can't find the container with id 86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353
Oct 31 08:02:54.591358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:54.591326    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" event={"ID":"38842c17-1cbd-4918-8ad7-a9c497d2c2e0","Type":"ContainerStarted","Data":"34d0adb5e2ed5496a45015100756738222ae831b3961684660b31499607011c8"}
Oct 31 08:02:54.591548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:54.591377    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" event={"ID":"38842c17-1cbd-4918-8ad7-a9c497d2c2e0","Type":"ContainerStarted","Data":"86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353"}
Oct 31 08:02:54.591548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:54.591397    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:02:54.707899 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:54.707828    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podStartSLOduration=1.707806643 podStartE2EDuration="1.707806643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:54.704267758 +0000 UTC m=+1984.316477501" watchObservedRunningTime="2026-10-31 08:02:54.707806643 +0000 UTC m=+1984.320016390"
Oct 31 08:02:57.635951 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:57.635908    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" event={"ID":"2d151715-d546-4102-862b-acabfd8ae128","Type":"ContainerStarted","Data":"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"}
Oct 31 08:02:58.110159 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:02:58.110071    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:03.109041 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:03.108925    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:03.121557 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:03.121521    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:03.236155 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:03.236092    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" podStartSLOduration=7.714309399 podStartE2EDuration="11.236074051s" totalImagesPullingTime="3.521764652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:57.758634579 +0000 UTC m=+1987.370844324" watchObservedRunningTime="2026-10-31 08:03:03.236074051 +0000 UTC m=+1992.848283794"
Oct 31 08:03:03.719378 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:03.719350    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:10.528992 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:03:10.528941    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:03:25.598192 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:25.598161    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:03:32.817803 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:32.817768    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:03:32.842679 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:32.842648    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:03:32.852047 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:03:32.851861    5872 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530" cmd=["/bin/sleep","15"]
Oct 31 08:03:32.852047 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:32.851935    5872 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 08:03:32.852047 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:03:32.851953    5872 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" podUID="2d151715-d546-4102-862b-acabfd8ae128" containerName="main" containerID="cri-o://e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"
Oct 31 08:03:32.852047 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:32.852012    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" podUID="2d151715-d546-4102-862b-acabfd8ae128" containerName="main" containerID="cri-o://e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530" gracePeriod=60
Oct 31 08:03:33.592255 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.592228    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:33.643811 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.643783    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.643955 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.643838    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.643955 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.643912    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\" (UniqueName: \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.644089 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.643953    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.644089 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644044    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.644169 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644086    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:03:33.644169 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644097    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\") pod \"2d151715-d546-4102-862b-acabfd8ae128\" (UID: \"2d151715-d546-4102-862b-acabfd8ae128\") "
Oct 31 08:03:33.644348 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644299    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:03:33.644433 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644403    5872 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-model-cache\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.644433 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644421    5872 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-tmp-dir\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.644542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.644504    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:03:33.646260 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.646236    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:03:33.646374 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.646235    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "kube-api-access-6qkjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:03:33.646374 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.646312    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs" pod "2d151715-d546-4102-862b-acabfd8ae128" (UID: "2d151715-d546-4102-862b-acabfd8ae128"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:03:33.745420 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.745343    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d151715-d546-4102-862b-acabfd8ae128-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.745420 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.745372    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qkjn\" (UniqueName: \"kubernetes.io/projected/2d151715-d546-4102-862b-acabfd8ae128-kube-api-access-6qkjn\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.745420 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.745387    5872 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-dshm\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.745420 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.745396    5872 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d151715-d546-4102-862b-acabfd8ae128-home\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:03:33.864248 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.864215    5872 generic.go:356] "Generic (PLEG): container finished" podID="2d151715-d546-4102-862b-acabfd8ae128" containerID="e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530" exitCode=0
Oct 31 08:03:33.864681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.864272    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"
Oct 31 08:03:33.864681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.864290    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" event={"ID":"2d151715-d546-4102-862b-acabfd8ae128","Type":"ContainerDied","Data":"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"}
Oct 31 08:03:33.864681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.864359    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf" event={"ID":"2d151715-d546-4102-862b-acabfd8ae128","Type":"ContainerDied","Data":"1bb110c1f19b95e1c67190690edd5ad0d5c6a103f499e2b627f4759cc2546bc5"}
Oct 31 08:03:33.864681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.864384    5872 scope.go:122] "RemoveContainer" containerID="e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"
Oct 31 08:03:33.875189 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.875171    5872 scope.go:122] "RemoveContainer" containerID="e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"
Oct 31 08:03:33.875413 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:03:33.875396    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530\": container with ID starting with e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530 not found: ID does not exist" containerID="e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"
Oct 31 08:03:33.875461 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:33.875422    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530"} err="failed to get container status \"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530\": rpc error: code = NotFound desc = could not find container \"e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530\": container with ID starting with e88750f5266c69f52019b79ae4c80d90a860c7cee81af94f6ca5b8a6a9d37530 not found: ID does not exist"
Oct 31 08:03:34.027578 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:34.027483    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:03:34.030859 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:34.030834    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776bz9cf"]
Oct 31 08:03:34.509239 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:34.509207    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d151715-d546-4102-862b-acabfd8ae128" path="/var/lib/kubelet/pods/2d151715-d546-4102-862b-acabfd8ae128/volumes"
Oct 31 08:03:35.598950 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:35.598912    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:03:40.527360 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:03:40.527325    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:03:45.599123 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:45.599088    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:03:47.842207 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:47.842150    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" containerID="cri-o://34d0adb5e2ed5496a45015100756738222ae831b3961684660b31499607011c8" gracePeriod=45
Oct 31 08:03:55.598684 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:55.598643    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:03:55.599116 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:03:55.598763    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:04:05.598696 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:05.598659    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:04:10.527887 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:04:10.527850    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:04:15.598372 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:15.598338    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:04:18.085923 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.085896    5872 generic.go:356] "Generic (PLEG): container finished" podID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerID="34d0adb5e2ed5496a45015100756738222ae831b3961684660b31499607011c8" exitCode=0
Oct 31 08:04:18.086243 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.085931    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" event={"ID":"38842c17-1cbd-4918-8ad7-a9c497d2c2e0","Type":"ContainerDied","Data":"34d0adb5e2ed5496a45015100756738222ae831b3961684660b31499607011c8"}
Oct 31 08:04:18.086243 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.085981    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58" event={"ID":"38842c17-1cbd-4918-8ad7-a9c497d2c2e0","Type":"ContainerDied","Data":"86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353"}
Oct 31 08:04:18.086243 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.086005    5872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86f323542a3887a088b25a1c25f1fecdb15b043d3f499c8e64988635beaf3353"
Oct 31 08:04:18.096841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.096821    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:04:18.148003 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.147935    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\" (UniqueName: \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\") pod \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") "
Oct 31 08:04:18.148106 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.148022    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\" (UniqueName: \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\") pod \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\" (UID: \"38842c17-1cbd-4918-8ad7-a9c497d2c2e0\") "
Oct 31 08:04:18.149712 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.149690    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs" pod "38842c17-1cbd-4918-8ad7-a9c497d2c2e0" (UID: "38842c17-1cbd-4918-8ad7-a9c497d2c2e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:04:18.150018 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.150001    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c" pod "38842c17-1cbd-4918-8ad7-a9c497d2c2e0" (UID: "38842c17-1cbd-4918-8ad7-a9c497d2c2e0"). InnerVolumeSpecName "kube-api-access-vrw4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:04:18.249361 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.249326    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:04:18.249361 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:18.249355    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrw4c\" (UniqueName: \"kubernetes.io/projected/38842c17-1cbd-4918-8ad7-a9c497d2c2e0-kube-api-access-vrw4c\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:04:19.090468 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:19.090435    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"
Oct 31 08:04:19.253335 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:19.253306    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:04:19.303210 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:19.303182    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedccw58"]
Oct 31 08:04:20.509646 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:20.509610    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" path="/var/lib/kubelet/pods/38842c17-1cbd-4918-8ad7-a9c497d2c2e0/volumes"
Oct 31 08:04:24.392194 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392161    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:04:24.392586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392532    5872 cpu_manager.go:414] "containerMap: removing container" podUID="2d151715-d546-4102-862b-acabfd8ae128" containerName="main"
Oct 31 08:04:24.392586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392543    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d151715-d546-4102-862b-acabfd8ae128" containerName="main"
Oct 31 08:04:24.392586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392566    5872 cpu_manager.go:414] "containerMap: removing container" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main"
Oct 31 08:04:24.392586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392571    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main"
Oct 31 08:04:24.392715 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392645    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d151715-d546-4102-862b-acabfd8ae128" containerName="main"
Oct 31 08:04:24.392715 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.392654    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="38842c17-1cbd-4918-8ad7-a9c497d2c2e0" containerName="main"
Oct 31 08:04:24.395845 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.395827    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.448193 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.448167    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"openshift-service-ca.crt\""
Oct 31 08:04:24.497958 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.497924    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"kube-root-ca.crt\""
Oct 31 08:04:24.498165 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.498150    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-kserve-self-signed-certs\""
Oct 31 08:04:24.498223 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.498194    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"default-dockercfg-tw6x8\""
Oct 31 08:04:24.498223 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.498211    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-epp-sa-dockercfg-dsskf\""
Oct 31 08:04:24.500077 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.500058    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:04:24.511353 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.511321    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.511480 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.511406    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwwn\" (UniqueName: \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.612236 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.612198    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.612426 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.612276    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwwn\" (UniqueName: \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.615087 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.615064    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.668977 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.668946    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwwn\" (UniqueName: \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:24.709106 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:24.709081    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:25.078464 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:25.078438    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:04:25.080857 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:04:25.080829    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59024a74_c768_428c_a520_8482ec756d65.slice/crio-e0e8a3c901ac9ca251a76569f8ae44bfcc1f040eb27e8e657bf8b8d15d86b2a1 WatchSource:0}: Error finding container e0e8a3c901ac9ca251a76569f8ae44bfcc1f040eb27e8e657bf8b8d15d86b2a1: Status 404 returned error can't find the container with id e0e8a3c901ac9ca251a76569f8ae44bfcc1f040eb27e8e657bf8b8d15d86b2a1
Oct 31 08:04:25.122273 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:25.122247    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" event={"ID":"59024a74-c768-428c-a520-8482ec756d65","Type":"ContainerStarted","Data":"e0e8a3c901ac9ca251a76569f8ae44bfcc1f040eb27e8e657bf8b8d15d86b2a1"}
Oct 31 08:04:26.128389 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:26.128353    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" event={"ID":"59024a74-c768-428c-a520-8482ec756d65","Type":"ContainerStarted","Data":"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"}
Oct 31 08:04:26.128796 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:26.128419    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:04:26.241760 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:26.241706    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podStartSLOduration=2.241693192 podStartE2EDuration="2.241693192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:04:26.240542042 +0000 UTC m=+2075.852751787" watchObservedRunningTime="2026-10-31 08:04:26.241693192 +0000 UTC m=+2075.853902934"
Oct 31 08:04:29.475048 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.474564    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:04:29.517275 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.517235    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.532765 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.532735    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:04:29.579942 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.578336    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"default-dockercfg-6t9jp\""
Oct 31 08:04:29.625555 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.625502    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlq6n\" (UniqueName: \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.625750 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.625641    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.628943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.628629    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-epp-sa-dockercfg-8csp5\""
Oct 31 08:04:29.628943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.628704    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-kserve-self-signed-certs\""
Oct 31 08:04:29.628943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.628815    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"kube-root-ca.crt\""
Oct 31 08:04:29.628943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.628906    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"openshift-service-ca.crt\""
Oct 31 08:04:29.726275 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.726167    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.726463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.726272    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlq6n\" (UniqueName: \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.730955 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.730925    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.806264 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.806229    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlq6n\" (UniqueName: \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:29.839279 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:29.839245    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:30.370057 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:30.366352    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:04:30.392756 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:04:30.392386    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f9de51_a77d_44a9_943b_98601e19bac5.slice/crio-b3f6dd00f14bc17b02d2bcc82d451074f17bb89d52c469ca12e6fa00b00f1a17 WatchSource:0}: Error finding container b3f6dd00f14bc17b02d2bcc82d451074f17bb89d52c469ca12e6fa00b00f1a17: Status 404 returned error can't find the container with id b3f6dd00f14bc17b02d2bcc82d451074f17bb89d52c469ca12e6fa00b00f1a17
Oct 31 08:04:31.230796 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:31.229052    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" event={"ID":"30f9de51-a77d-44a9-943b-98601e19bac5","Type":"ContainerStarted","Data":"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"}
Oct 31 08:04:31.230796 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:31.229141    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" event={"ID":"30f9de51-a77d-44a9-943b-98601e19bac5","Type":"ContainerStarted","Data":"b3f6dd00f14bc17b02d2bcc82d451074f17bb89d52c469ca12e6fa00b00f1a17"}
Oct 31 08:04:31.230796 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:31.230096    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:04:31.369994 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:31.362943    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podStartSLOduration=2.362921683 podStartE2EDuration="2.362921683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:04:31.360762037 +0000 UTC m=+2080.972971779" watchObservedRunningTime="2026-10-31 08:04:31.362921683 +0000 UTC m=+2080.975131426"
Oct 31 08:04:40.528208 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:04:40.528050    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:04:50.772326 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:50.772294    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:04:50.781160 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:50.781134    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:04:50.789516 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:50.789495    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:04:50.797056 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:50.797041    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:04:57.134825 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:04:57.134794    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:05:03.245548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:03.245516    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:05:10.527841 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:05:10.527801    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:05:25.679770 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:25.679725    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:05:33.244820 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:33.244783    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:05:40.527938 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:05:40.527898    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:05:40.700270 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:40.700221    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main" containerID="cri-o://6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494" gracePeriod=45
Oct 31 08:05:43.244832 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:43.244792    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:05:53.245078 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:53.245041    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:05:53.245483 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:05:53.245152    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:06:03.245185 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:03.245101    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:06:10.528051 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:06:10.528015    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:06:10.948487 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:10.948465    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:06:11.064730 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.064171    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\") pod \"30f9de51-a77d-44a9-943b-98601e19bac5\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") "
Oct 31 08:06:11.064730 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.064290    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\" (UniqueName: \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\") pod \"30f9de51-a77d-44a9-943b-98601e19bac5\" (UID: \"30f9de51-a77d-44a9-943b-98601e19bac5\") "
Oct 31 08:06:11.066284 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.066253    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs" pod "30f9de51-a77d-44a9-943b-98601e19bac5" (UID: "30f9de51-a77d-44a9-943b-98601e19bac5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:06:11.066400 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.066350    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n" pod "30f9de51-a77d-44a9-943b-98601e19bac5" (UID: "30f9de51-a77d-44a9-943b-98601e19bac5"). InnerVolumeSpecName "kube-api-access-qlq6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:06:11.165451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.165425    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9de51-a77d-44a9-943b-98601e19bac5-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:06:11.165451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.165450    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlq6n\" (UniqueName: \"kubernetes.io/projected/30f9de51-a77d-44a9-943b-98601e19bac5-kube-api-access-qlq6n\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:06:11.750829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.750784    5872 generic.go:356] "Generic (PLEG): container finished" podID="30f9de51-a77d-44a9-943b-98601e19bac5" containerID="6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494" exitCode=0
Oct 31 08:06:11.751304 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.750838    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"
Oct 31 08:06:11.751304 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.750848    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" event={"ID":"30f9de51-a77d-44a9-943b-98601e19bac5","Type":"ContainerDied","Data":"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"}
Oct 31 08:06:11.751304 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.750904    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb" event={"ID":"30f9de51-a77d-44a9-943b-98601e19bac5","Type":"ContainerDied","Data":"b3f6dd00f14bc17b02d2bcc82d451074f17bb89d52c469ca12e6fa00b00f1a17"}
Oct 31 08:06:11.751304 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.750927    5872 scope.go:122] "RemoveContainer" containerID="6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"
Oct 31 08:06:11.760340 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.760320    5872 scope.go:122] "RemoveContainer" containerID="6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"
Oct 31 08:06:11.760602 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:06:11.760580    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494\": container with ID starting with 6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494 not found: ID does not exist" containerID="6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"
Oct 31 08:06:11.760669 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.760613    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494"} err="failed to get container status \"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494\": rpc error: code = NotFound desc = could not find container \"6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494\": container with ID starting with 6840a48be84f500a920443b64495e5d0477b211055c731b2b389e29813aad494 not found: ID does not exist"
Oct 31 08:06:11.913255 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.913213    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:06:11.963438 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:11.963398    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cxmtxb"]
Oct 31 08:06:12.514761 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:12.514728    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" path="/var/lib/kubelet/pods/30f9de51-a77d-44a9-943b-98601e19bac5/volumes"
Oct 31 08:06:21.244061 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.244028    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:06:21.244440 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.244426    5872 cpu_manager.go:414] "containerMap: removing container" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main"
Oct 31 08:06:21.244483 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.244441    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main"
Oct 31 08:06:21.244527 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.244518    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="30f9de51-a77d-44a9-943b-98601e19bac5" containerName="main"
Oct 31 08:06:21.247759 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.247738    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.299841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.299805    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"openshift-service-ca.crt\""
Oct 31 08:06:21.352088 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.352058    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"kube-root-ca.crt\""
Oct 31 08:06:21.352088 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.352072    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"default-dockercfg-s4gtz\""
Oct 31 08:06:21.352341 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.352130    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-kserve-self-signed-certs\""
Oct 31 08:06:21.352341 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.352248    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-epp-sa-dockercfg-28vd6\""
Oct 31 08:06:21.353890 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.353869    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:06:21.355689 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.355671    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2g8h\" (UniqueName: \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.355743 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.355700    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.456707 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.456671    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2g8h\" (UniqueName: \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.456707 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.456709    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.459367 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.459338    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.513704 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.513631    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2g8h\" (UniqueName: \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.560743 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.560714    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:21.931123 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:21.931097    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:06:21.933881 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:06:21.933856    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbdb023_c5da_4f42_a801_8db7d2d89ca7.slice/crio-07e04c3681e9cec95251cbf652af803639f3efc648d24548e5ae5cdcd5002dc9 WatchSource:0}: Error finding container 07e04c3681e9cec95251cbf652af803639f3efc648d24548e5ae5cdcd5002dc9: Status 404 returned error can't find the container with id 07e04c3681e9cec95251cbf652af803639f3efc648d24548e5ae5cdcd5002dc9
Oct 31 08:06:22.810932 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:22.810892    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" event={"ID":"9fbdb023-c5da-4f42-a801-8db7d2d89ca7","Type":"ContainerStarted","Data":"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"}
Oct 31 08:06:22.811331 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:22.810958    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" event={"ID":"9fbdb023-c5da-4f42-a801-8db7d2d89ca7","Type":"ContainerStarted","Data":"07e04c3681e9cec95251cbf652af803639f3efc648d24548e5ae5cdcd5002dc9"}
Oct 31 08:06:22.811331 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:22.811109    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:22.925291 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:22.925227    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podStartSLOduration=1.925208739 podStartE2EDuration="1.925208739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:06:22.92420886 +0000 UTC m=+2192.536418603" watchObservedRunningTime="2026-10-31 08:06:22.925208739 +0000 UTC m=+2192.537418485"
Oct 31 08:06:25.578292 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:25.578252    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:06:27.135015 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:27.134952    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:06:37.135548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:37.135504    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:06:40.527551 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:06:40.527518    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:06:40.599954 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:40.599890    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" containerID="cri-o://bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa" gracePeriod=45
Oct 31 08:06:47.135386 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:47.135346    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:06:47.135776 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:47.135461    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:06:53.817804 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:53.817772    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:06:57.134818 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:06:57.134782    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:07.135001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:07.134946    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:10.527454 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:07:10.527421    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:07:10.847444 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:10.847417    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:07:10.990266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:10.990236    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\" (UniqueName: \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\") pod \"59024a74-c768-428c-a520-8482ec756d65\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") "
Oct 31 08:07:10.990419 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:10.990310    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\" (UniqueName: \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\") pod \"59024a74-c768-428c-a520-8482ec756d65\" (UID: \"59024a74-c768-428c-a520-8482ec756d65\") "
Oct 31 08:07:10.992452 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:10.992424    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs" pod "59024a74-c768-428c-a520-8482ec756d65" (UID: "59024a74-c768-428c-a520-8482ec756d65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:07:10.992557 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:10.992478    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn" pod "59024a74-c768-428c-a520-8482ec756d65" (UID: "59024a74-c768-428c-a520-8482ec756d65"). InnerVolumeSpecName "kube-api-access-ldwwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:07:11.072695 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.072658    5872 generic.go:356] "Generic (PLEG): container finished" podID="59024a74-c768-428c-a520-8482ec756d65" containerID="bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa" exitCode=0
Oct 31 08:07:11.072847 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.072705    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" event={"ID":"59024a74-c768-428c-a520-8482ec756d65","Type":"ContainerDied","Data":"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"}
Oct 31 08:07:11.072847 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.072719    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"
Oct 31 08:07:11.072847 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.072767    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4" event={"ID":"59024a74-c768-428c-a520-8482ec756d65","Type":"ContainerDied","Data":"e0e8a3c901ac9ca251a76569f8ae44bfcc1f040eb27e8e657bf8b8d15d86b2a1"}
Oct 31 08:07:11.072847 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.072799    5872 scope.go:122] "RemoveContainer" containerID="bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"
Oct 31 08:07:11.082096 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.082037    5872 scope.go:122] "RemoveContainer" containerID="bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"
Oct 31 08:07:11.082282 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:07:11.082266    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa\": container with ID starting with bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa not found: ID does not exist" containerID="bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"
Oct 31 08:07:11.082331 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.082289    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa"} err="failed to get container status \"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa\": rpc error: code = NotFound desc = could not find container \"bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa\": container with ID starting with bdabf9c58060eb3c3d0df6c3ed4f423fa27caa59114f8eedbc9a625d469010fa not found: ID does not exist"
Oct 31 08:07:11.091733 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.091711    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldwwn\" (UniqueName: \"kubernetes.io/projected/59024a74-c768-428c-a520-8482ec756d65-kube-api-access-ldwwn\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:07:11.091822 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.091736    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59024a74-c768-428c-a520-8482ec756d65-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:07:11.236539 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.236509    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:07:11.238317 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:11.238297    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894w7xh4"]
Oct 31 08:07:12.508266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:12.508230    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59024a74-c768-428c-a520-8482ec756d65" path="/var/lib/kubelet/pods/59024a74-c768-428c-a520-8482ec756d65/volumes"
Oct 31 08:07:13.694684 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:13.694647    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:07:13.817860 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:13.817822    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:23.818906 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:23.818863    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:28.715734 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:28.715647    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" containerID="cri-o://85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4" gracePeriod=45
Oct 31 08:07:33.817832 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:33.817790    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:33.818293 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:33.817922    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:07:40.527333 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:07:40.527293    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:07:43.818504 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:43.818463    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:53.818512 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:53.818473    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:07:58.970505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:58.970476    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:07:59.118505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.118430    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\") pod \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") "
Oct 31 08:07:59.118505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.118477    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\" (UniqueName: \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\") pod \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\" (UID: \"9fbdb023-c5da-4f42-a801-8db7d2d89ca7\") "
Oct 31 08:07:59.120643 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.120612    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs" pod "9fbdb023-c5da-4f42-a801-8db7d2d89ca7" (UID: "9fbdb023-c5da-4f42-a801-8db7d2d89ca7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:07:59.120643 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.120616    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h" pod "9fbdb023-c5da-4f42-a801-8db7d2d89ca7" (UID: "9fbdb023-c5da-4f42-a801-8db7d2d89ca7"). InnerVolumeSpecName "kube-api-access-x2g8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:07:59.220026 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.219990    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:07:59.220026 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.220020    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2g8h\" (UniqueName: \"kubernetes.io/projected/9fbdb023-c5da-4f42-a801-8db7d2d89ca7-kube-api-access-x2g8h\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:07:59.328237 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.328203    5872 generic.go:356] "Generic (PLEG): container finished" podID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerID="85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4" exitCode=0
Oct 31 08:07:59.328417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.328253    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"
Oct 31 08:07:59.328417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.328285    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" event={"ID":"9fbdb023-c5da-4f42-a801-8db7d2d89ca7","Type":"ContainerDied","Data":"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"}
Oct 31 08:07:59.328417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.328339    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r" event={"ID":"9fbdb023-c5da-4f42-a801-8db7d2d89ca7","Type":"ContainerDied","Data":"07e04c3681e9cec95251cbf652af803639f3efc648d24548e5ae5cdcd5002dc9"}
Oct 31 08:07:59.328417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.328365    5872 scope.go:122] "RemoveContainer" containerID="85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"
Oct 31 08:07:59.337508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.337494    5872 scope.go:122] "RemoveContainer" containerID="85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"
Oct 31 08:07:59.337736 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:07:59.337714    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4\": container with ID starting with 85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4 not found: ID does not exist" containerID="85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"
Oct 31 08:07:59.337796 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.337749    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4"} err="failed to get container status \"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4\": rpc error: code = NotFound desc = could not find container \"85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4\": container with ID starting with 85bec6d1bd95b4bf9fd5ea47458bde4bb355a89daaa9243dd1e19babb8c772c4 not found: ID does not exist"
Oct 31 08:07:59.490471 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.490439    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:07:59.540647 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:07:59.540613    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-5666f9h2r"]
Oct 31 08:08:00.508722 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:08:00.508688    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" path="/var/lib/kubelet/pods/9fbdb023-c5da-4f42-a801-8db7d2d89ca7/volumes"
Oct 31 08:08:10.527103 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:08:10.527064    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:08:40.526386 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:08:40.526347    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:09:10.527464 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:09:10.527386    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:09:40.527420 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:09:40.527382    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:09:50.807136 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:09:50.807107    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:09:50.817166 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:09:50.817142    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:09:50.824043 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:09:50.824022    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:09:50.833406 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:09:50.833388    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:09:50.870323 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:09:50.870295    5872 scope.go:122] "RemoveContainer" containerID="34d0adb5e2ed5496a45015100756738222ae831b3961684660b31499607011c8"
Oct 31 08:10:10.528035 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:10:10.527996    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:10:22.596630 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.596591    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597018    5872 cpu_manager.go:414] "containerMap: removing container" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main"
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597032    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main"
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597051    5872 cpu_manager.go:414] "containerMap: removing container" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main"
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597057    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main"
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597129    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="59024a74-c768-428c-a520-8482ec756d65" containerName="main"
Oct 31 08:10:22.597167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.597138    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fbdb023-c5da-4f42-a801-8db7d2d89ca7" containerName="main"
Oct 31 08:10:22.600150 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.600134    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.702413 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.702376    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\""
Oct 31 08:10:22.702616 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.702451    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-dpjc7\""
Oct 31 08:10:22.702616 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.702492    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-gtczj\""
Oct 31 08:10:22.702616 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.702577    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\""
Oct 31 08:10:22.702895 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.702880    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\""
Oct 31 08:10:22.704618 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.704590    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:10:22.712363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.712341    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.712481 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.712407    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tqxp\" (UniqueName: \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.813313 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.813283    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tqxp\" (UniqueName: \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.813493 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.813345    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.815923 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.815902    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.873996 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.873911    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tqxp\" (UniqueName: \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:22.912693 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:22.912668    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:23.283207 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:23.283180    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:10:23.285455 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:10:23.285423    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4ec52c_4c48_4f84_ac3f_cfff70472200.slice/crio-0d7e436f8f2ccab6a00eb2940fcd555d0787b1e9bcf9a88539f7ed5900fa0b4d WatchSource:0}: Error finding container 0d7e436f8f2ccab6a00eb2940fcd555d0787b1e9bcf9a88539f7ed5900fa0b4d: Status 404 returned error can't find the container with id 0d7e436f8f2ccab6a00eb2940fcd555d0787b1e9bcf9a88539f7ed5900fa0b4d
Oct 31 08:10:24.070254 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:24.070216    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" event={"ID":"3c4ec52c-4c48-4f84-ac3f-cfff70472200","Type":"ContainerStarted","Data":"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"}
Oct 31 08:10:24.070648 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:24.070280    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" event={"ID":"3c4ec52c-4c48-4f84-ac3f-cfff70472200","Type":"ContainerStarted","Data":"0d7e436f8f2ccab6a00eb2940fcd555d0787b1e9bcf9a88539f7ed5900fa0b4d"}
Oct 31 08:10:24.070648 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:24.070309    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:10:24.183741 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:24.183678    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podStartSLOduration=2.183661966 podStartE2EDuration="2.183661966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:10:24.183065482 +0000 UTC m=+2433.795275222" watchObservedRunningTime="2026-10-31 08:10:24.183661966 +0000 UTC m=+2433.795871710"
Oct 31 08:10:40.527066 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:10:40.527024    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:10:42.546388 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.546356    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:10:42.550254 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.550235    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656287 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656251    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656287 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656288    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656326    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656453    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656487    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656610 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656517    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656610 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656592    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndk5v\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656614    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.656680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.656641    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.750446 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.750411    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:10:42.757572 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757540    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.757717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757595    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndk5v\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.757717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757614    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.757717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757643    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.757717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757671    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.757717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.757689    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758066 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758039    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758133 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758102    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758191 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758178    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758248    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758326 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758286    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758531 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758508    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758622 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758550    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.758716 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.758693    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.760523 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.760503    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.760850 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.760827    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.816482 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.816414    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.816589 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.816530    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndk5v\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-s82bl\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:42.864295 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:42.864271    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:43.286147 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:43.286054    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:10:43.288508 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:10:43.288478    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ad1c08_ed22_4673_80fa_e79356f9e1d7.slice/crio-b2ac7c2bfd8eec271a0f9fcdd46cd6046938237187ab49706355a166fc4d5ac8 WatchSource:0}: Error finding container b2ac7c2bfd8eec271a0f9fcdd46cd6046938237187ab49706355a166fc4d5ac8: Status 404 returned error can't find the container with id b2ac7c2bfd8eec271a0f9fcdd46cd6046938237187ab49706355a166fc4d5ac8
Oct 31 08:10:43.290682 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:43.290649    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:10:43.290772 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:43.290713    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:10:43.290772 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:43.290747    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:10:44.214790 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.214751    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" event={"ID":"d7ad1c08-ed22-4673-80fa-e79356f9e1d7","Type":"ContainerStarted","Data":"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"}
Oct 31 08:10:44.215263 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.214819    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" event={"ID":"d7ad1c08-ed22-4673-80fa-e79356f9e1d7","Type":"ContainerStarted","Data":"b2ac7c2bfd8eec271a0f9fcdd46cd6046938237187ab49706355a166fc4d5ac8"}
Oct 31 08:10:44.421246 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.421193    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podStartSLOduration=2.421177515 podStartE2EDuration="2.421177515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:10:44.371327615 +0000 UTC m=+2453.983537358" watchObservedRunningTime="2026-10-31 08:10:44.421177515 +0000 UTC m=+2454.033387257"
Oct 31 08:10:44.868261 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.868231    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:44.870538 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.870510    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 08:10:44.870739 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:44.870713    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 08:10:45.872109 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:45.872066    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 08:10:45.872651 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:45.872123    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 08:10:46.866614 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:46.866577    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 08:10:46.866883 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:46.866855    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 08:10:47.872385 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:47.872344    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 08:10:47.872884 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:47.872410    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 08:10:48.865995 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:48.865320    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 08:10:48.865995 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:48.865383    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 08:10:49.868530 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:49.868502    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:49.868921 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:49.868746    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:49.869378 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:49.869360    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:10:55.084575 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:10:55.084537    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:11:10.531933 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:11:10.531895    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:11:16.246113 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:16.246078    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:11:25.084835 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:25.084792    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:11:31.266366 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:31.266320    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main" containerID="cri-o://87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1" gracePeriod=45
Oct 31 08:11:35.084577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:35.084539    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:11:40.528949 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:11:40.528906    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:11:45.084519 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:45.084479    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:11:45.084908 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:45.084594    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:11:55.085233 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:11:55.085194    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:12:01.522656 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.522632    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:12:01.585282 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.585224    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\" (UniqueName: \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\") pod \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") "
Oct 31 08:12:01.585282 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.585268    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\") pod \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\" (UID: \"3c4ec52c-4c48-4f84-ac3f-cfff70472200\") "
Oct 31 08:12:01.587418 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.587391    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp" pod "3c4ec52c-4c48-4f84-ac3f-cfff70472200" (UID: "3c4ec52c-4c48-4f84-ac3f-cfff70472200"). InnerVolumeSpecName "kube-api-access-2tqxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:12:01.587513 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.587476    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs" pod "3c4ec52c-4c48-4f84-ac3f-cfff70472200" (UID: "3c4ec52c-4c48-4f84-ac3f-cfff70472200"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:12:01.620389 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.620357    5872 generic.go:356] "Generic (PLEG): container finished" podID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerID="87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1" exitCode=0
Oct 31 08:12:01.620505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.620401    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"
Oct 31 08:12:01.620505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.620438    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" event={"ID":"3c4ec52c-4c48-4f84-ac3f-cfff70472200","Type":"ContainerDied","Data":"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"}
Oct 31 08:12:01.620505 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.620491    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl" event={"ID":"3c4ec52c-4c48-4f84-ac3f-cfff70472200","Type":"ContainerDied","Data":"0d7e436f8f2ccab6a00eb2940fcd555d0787b1e9bcf9a88539f7ed5900fa0b4d"}
Oct 31 08:12:01.620613 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.620514    5872 scope.go:122] "RemoveContainer" containerID="87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"
Oct 31 08:12:01.629935 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.629919    5872 scope.go:122] "RemoveContainer" containerID="87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"
Oct 31 08:12:01.630221 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:12:01.630200    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1\": container with ID starting with 87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1 not found: ID does not exist" containerID="87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"
Oct 31 08:12:01.630291 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.630234    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1"} err="failed to get container status \"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1\": rpc error: code = NotFound desc = could not find container \"87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1\": container with ID starting with 87ac9bf9ac476d1e0fc0993465b8c2de511a62355169470cbb4dda93f8fb87d1 not found: ID does not exist"
Oct 31 08:12:01.685824 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.685787    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tqxp\" (UniqueName: \"kubernetes.io/projected/3c4ec52c-4c48-4f84-ac3f-cfff70472200-kube-api-access-2tqxp\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:12:01.685824 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.685819    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c4ec52c-4c48-4f84-ac3f-cfff70472200-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:12:01.746446 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.746404    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:12:01.750306 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:01.750279    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6vpgsl"]
Oct 31 08:12:02.508323 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:02.508292    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" path="/var/lib/kubelet/pods/3c4ec52c-4c48-4f84-ac3f-cfff70472200/volumes"
Oct 31 08:12:09.962694 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:09.962657    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:12:09.963108 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:09.963091    5872 cpu_manager.go:414] "containerMap: removing container" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main"
Oct 31 08:12:09.963162 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:09.963109    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main"
Oct 31 08:12:09.963257 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:09.963240    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c4ec52c-4c48-4f84-ac3f-cfff70472200" containerName="main"
Oct 31 08:12:09.967801 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:09.967783    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.021139 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.020937    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"openshift-service-ca.crt\""
Oct 31 08:12:10.058010 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.057950    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.058164 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.058069    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqvl9\" (UniqueName: \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.070604 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.070574    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Oct 31 08:12:10.070604 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.070575    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"kube-root-ca.crt\""
Oct 31 08:12:10.070797 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.070607    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"default-dockercfg-x6pvm\""
Oct 31 08:12:10.070797 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.070642    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-twvwj\""
Oct 31 08:12:10.072726 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.072703    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:12:10.159174 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.159146    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqvl9\" (UniqueName: \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.159373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.159234    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.161744 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.161718    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.215414 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.215343    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqvl9\" (UniqueName: \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.280447 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.280409    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:10.530599 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:12:10.530519    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:12:10.653844 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.653805    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:12:10.656464 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:12:10.656435    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb46d41_931c_40d1_ba78_cff0ffb9138b.slice/crio-8cd89962a9c357858f965b47564900019b1341a1bc83804d98036a940bb087eb WatchSource:0}: Error finding container 8cd89962a9c357858f965b47564900019b1341a1bc83804d98036a940bb087eb: Status 404 returned error can't find the container with id 8cd89962a9c357858f965b47564900019b1341a1bc83804d98036a940bb087eb
Oct 31 08:12:10.668424 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:10.668398    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" event={"ID":"aeb46d41-931c-40d1-ba78-cff0ffb9138b","Type":"ContainerStarted","Data":"8cd89962a9c357858f965b47564900019b1341a1bc83804d98036a940bb087eb"}
Oct 31 08:12:11.675350 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:11.675309    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" event={"ID":"aeb46d41-931c-40d1-ba78-cff0ffb9138b","Type":"ContainerStarted","Data":"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"}
Oct 31 08:12:11.675851 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:11.675416    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:11.788438 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:11.788387    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podStartSLOduration=2.7883735339999998 podStartE2EDuration="2.788373534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:12:11.786911552 +0000 UTC m=+2541.399121295" watchObservedRunningTime="2026-10-31 08:12:11.788373534 +0000 UTC m=+2541.400583275"
Oct 31 08:12:40.528918 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:12:40.528873    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:12:42.683059 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:42.683029    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:12:49.249857 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:49.249822    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:12:52.682595 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:12:52.682556    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:13:02.682514 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:02.682472    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:13:04.270133 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:04.270087    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" containerID="cri-o://8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1" gracePeriod=45
Oct 31 08:13:10.527074 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:13:10.527035    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:13:12.682590 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:12.682546    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:13:12.683006 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:12.682658    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:13:22.682515 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:22.682471    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:13:32.682803 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:32.682720    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:13:34.524543 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.524515    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:13:34.618650 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.618570    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\" (UniqueName: \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\") pod \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") "
Oct 31 08:13:34.618790 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.618668    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\") pod \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\" (UID: \"aeb46d41-931c-40d1-ba78-cff0ffb9138b\") "
Oct 31 08:13:34.620739 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.620709    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9" pod "aeb46d41-931c-40d1-ba78-cff0ffb9138b" (UID: "aeb46d41-931c-40d1-ba78-cff0ffb9138b"). InnerVolumeSpecName "kube-api-access-fqvl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:13:34.620843 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.620796    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs" pod "aeb46d41-931c-40d1-ba78-cff0ffb9138b" (UID: "aeb46d41-931c-40d1-ba78-cff0ffb9138b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:13:34.719613 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.719577    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb46d41-931c-40d1-ba78-cff0ffb9138b-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:13:34.719613 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:34.719610    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqvl9\" (UniqueName: \"kubernetes.io/projected/aeb46d41-931c-40d1-ba78-cff0ffb9138b-kube-api-access-fqvl9\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:13:35.105185 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.105145    5872 generic.go:356] "Generic (PLEG): container finished" podID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerID="8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1" exitCode=0
Oct 31 08:13:35.105394 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.105196    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"
Oct 31 08:13:35.105394 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.105229    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" event={"ID":"aeb46d41-931c-40d1-ba78-cff0ffb9138b","Type":"ContainerDied","Data":"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"}
Oct 31 08:13:35.105394 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.105297    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8" event={"ID":"aeb46d41-931c-40d1-ba78-cff0ffb9138b","Type":"ContainerDied","Data":"8cd89962a9c357858f965b47564900019b1341a1bc83804d98036a940bb087eb"}
Oct 31 08:13:35.105394 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.105327    5872 scope.go:122] "RemoveContainer" containerID="8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"
Oct 31 08:13:35.114531 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.114511    5872 scope.go:122] "RemoveContainer" containerID="8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"
Oct 31 08:13:35.114781 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:13:35.114763    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1\": container with ID starting with 8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1 not found: ID does not exist" containerID="8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"
Oct 31 08:13:35.114836 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.114791    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1"} err="failed to get container status \"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1\": rpc error: code = NotFound desc = could not find container \"8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1\": container with ID starting with 8ad106a4a251031d09b97d6b42bcae2c2ee9ecfde9fbc92f9ea7fc04e3db95c1 not found: ID does not exist"
Oct 31 08:13:35.268286 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.268253    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:13:35.318108 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:35.318070    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche85jj8"]
Oct 31 08:13:36.508896 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:36.508863    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" path="/var/lib/kubelet/pods/aeb46d41-931c-40d1-ba78-cff0ffb9138b/volumes"
Oct 31 08:13:40.527673 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:13:40.527628    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:13:44.887957 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.887922    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:13:44.888493 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.888325    5872 cpu_manager.go:414] "containerMap: removing container" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main"
Oct 31 08:13:44.888493 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.888336    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main"
Oct 31 08:13:44.888493 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.888410    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeb46d41-931c-40d1-ba78-cff0ffb9138b" containerName="main"
Oct 31 08:13:44.892783 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.892764    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:44.946277 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.946229    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\""
Oct 31 08:13:44.995793 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.995759    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\""
Oct 31 08:13:44.995793 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.995802    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Oct 31 08:13:44.996034 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.995924    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-p52xl\""
Oct 31 08:13:44.996034 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.995960    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-t9f64\""
Oct 31 08:13:44.997855 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:44.997832    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:13:45.014295 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.014268    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.014455 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.014325    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpk5k\" (UniqueName: \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.115461 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.115423    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.115647 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.115487    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpk5k\" (UniqueName: \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.117961 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.117940    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.172028 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.171997    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpk5k\" (UniqueName: \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.204863 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.204831    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:45.574508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:45.574485    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:13:45.576950 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:13:45.576919    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6bd70b_6064_4ee1_8872_3990ce6cf6b6.slice/crio-07efc7922751e2b56e3540b94c4cd004cb38b5d1dc7c9eac81d5761ed35b8666 WatchSource:0}: Error finding container 07efc7922751e2b56e3540b94c4cd004cb38b5d1dc7c9eac81d5761ed35b8666: Status 404 returned error can't find the container with id 07efc7922751e2b56e3540b94c4cd004cb38b5d1dc7c9eac81d5761ed35b8666
Oct 31 08:13:46.163840 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:46.163801    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" event={"ID":"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6","Type":"ContainerStarted","Data":"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"}
Oct 31 08:13:46.164282 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:46.163881    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" event={"ID":"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6","Type":"ContainerStarted","Data":"07efc7922751e2b56e3540b94c4cd004cb38b5d1dc7c9eac81d5761ed35b8666"}
Oct 31 08:13:46.164282 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:46.163947    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:13:46.278257 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:13:46.278200    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podStartSLOduration=2.278185551 podStartE2EDuration="2.278185551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:13:46.276435668 +0000 UTC m=+2635.888645424" watchObservedRunningTime="2026-10-31 08:13:46.278185551 +0000 UTC m=+2635.890395499"
Oct 31 08:14:10.528308 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:14:10.528271    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:14:17.171103 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:17.171077    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:14:24.662160 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.662123    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:14:24.665813 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.665796    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.722163 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.722131    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:14:24.769775 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.769740    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Oct 31 08:14:24.769775 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.769756    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-2nrfq\""
Oct 31 08:14:24.791372 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.791342    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nhdx\" (UniqueName: \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.791489 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.791397    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.892235 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.892197    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nhdx\" (UniqueName: \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.892443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.892256    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.894759 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.894732    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.951834 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.951760    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nhdx\" (UniqueName: \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:24.978262 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:24.978236    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:25.347673 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:25.347645    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:14:25.350131 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:14:25.350102    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7d431e_4bf3_4f61_bc7b_b892be525bd4.slice/crio-cfc357c3c7f6f09a6cd8c9c66af0f4d1057462d98d02a400178416d49983f534 WatchSource:0}: Error finding container cfc357c3c7f6f09a6cd8c9c66af0f4d1057462d98d02a400178416d49983f534: Status 404 returned error can't find the container with id cfc357c3c7f6f09a6cd8c9c66af0f4d1057462d98d02a400178416d49983f534
Oct 31 08:14:25.373063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:25.373040    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" event={"ID":"ed7d431e-4bf3-4f61-bc7b-b892be525bd4","Type":"ContainerStarted","Data":"cfc357c3c7f6f09a6cd8c9c66af0f4d1057462d98d02a400178416d49983f534"}
Oct 31 08:14:26.379805 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:26.379764    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" event={"ID":"ed7d431e-4bf3-4f61-bc7b-b892be525bd4","Type":"ContainerStarted","Data":"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"}
Oct 31 08:14:26.380199 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:26.379873    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:14:26.494889 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:26.494838    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podStartSLOduration=2.494824381 podStartE2EDuration="2.494824381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:14:26.492914651 +0000 UTC m=+2676.105124394" watchObservedRunningTime="2026-10-31 08:14:26.494824381 +0000 UTC m=+2676.107034123"
Oct 31 08:14:40.527452 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:14:40.527416    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:14:50.850495 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:50.850462    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:14:50.858878 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:50.858856    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:14:50.868680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:50.868658    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:14:50.876530 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:50.876511    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:14:57.387318 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:14:57.387284    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:15:10.527845 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:15:10.527759    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:15:22.467852 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:22.467818    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:15:27.387502 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:27.387461    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:15:37.387157 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:37.387075    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:15:37.489440 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:37.489400    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" containerID="cri-o://fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349" gracePeriod=45
Oct 31 08:15:40.528340 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:15:40.528297    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:15:47.386664 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:47.386627    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:15:47.387093 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:47.386732    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:15:57.387362 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:15:57.387326    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:00.038149 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:00.038110    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:16:00.038603 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:00.038320    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" containerID="cri-o://011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c" gracePeriod=30
Oct 31 08:16:04.871564 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:04.871530    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 08:16:04.871948 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:04.871594    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 08:16:05.288248 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.288224    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:16:05.340190 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340162    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340334 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340265    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340334 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340311    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340403 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340341    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340403 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340377    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340497 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340413    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340497 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340460    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:16:05.340497 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340484    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340655 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340513    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340655 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340544    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\") pod \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\" (UID: \"d7ad1c08-ed22-4673-80fa-e79356f9e1d7\") "
Oct 31 08:16:05.340655 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340599    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:16:05.340655 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340616    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:16:05.340850 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340719    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:16:05.340925 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340896    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.341001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340932    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.341001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340950    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.341001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.340988    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.341130 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.341011    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:16:05.343251 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.343216    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:16:05.343358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.343250    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "kube-api-access-ndk5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:16:05.343358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.343263    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:16:05.343358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.343253    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo" pod "d7ad1c08-ed22-4673-80fa-e79356f9e1d7" (UID: "d7ad1c08-ed22-4673-80fa-e79356f9e1d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:16:05.442229 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.442194    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.442229 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.442226    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.442416 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.442241    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndk5v\" (UniqueName: \"kubernetes.io/projected/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-kube-api-access-ndk5v\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.442416 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.442256    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.442416 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.442267    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ad1c08-ed22-4673-80fa-e79356f9e1d7-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:05.908021 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.907918    5872 generic.go:356] "Generic (PLEG): container finished" podID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerID="011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c" exitCode=0
Oct 31 08:16:05.908021 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.907983    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"
Oct 31 08:16:05.908021 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.908001    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" event={"ID":"d7ad1c08-ed22-4673-80fa-e79356f9e1d7","Type":"ContainerDied","Data":"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"}
Oct 31 08:16:05.908518 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.908057    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl" event={"ID":"d7ad1c08-ed22-4673-80fa-e79356f9e1d7","Type":"ContainerDied","Data":"b2ac7c2bfd8eec271a0f9fcdd46cd6046938237187ab49706355a166fc4d5ac8"}
Oct 31 08:16:05.908518 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.908076    5872 scope.go:122] "RemoveContainer" containerID="011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"
Oct 31 08:16:05.917799 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.917782    5872 scope.go:122] "RemoveContainer" containerID="011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"
Oct 31 08:16:05.918069 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:16:05.918051    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c\": container with ID starting with 011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c not found: ID does not exist" containerID="011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"
Oct 31 08:16:05.918130 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:05.918079    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c"} err="failed to get container status \"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c\": rpc error: code = NotFound desc = could not find container \"011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c\": container with ID starting with 011be7c585ee1f158bfe59bff4737357635173f2ff696398822e237a7c2a020c not found: ID does not exist"
Oct 31 08:16:06.099514 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:06.099481    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:16:06.105202 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:06.105177    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s82bl"]
Oct 31 08:16:06.508117 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:06.508075    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" path="/var/lib/kubelet/pods/d7ad1c08-ed22-4673-80fa-e79356f9e1d7/volumes"
Oct 31 08:16:07.387465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.387422    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:07.737383 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.737359    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:16:07.864254 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.864217    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\") pod \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") "
Oct 31 08:16:07.864435 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.864261    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\" (UniqueName: \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\") pod \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\" (UID: \"ed7d431e-4bf3-4f61-bc7b-b892be525bd4\") "
Oct 31 08:16:07.866548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.866511    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx" pod "ed7d431e-4bf3-4f61-bc7b-b892be525bd4" (UID: "ed7d431e-4bf3-4f61-bc7b-b892be525bd4"). InnerVolumeSpecName "kube-api-access-5nhdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:16:07.866660 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.866559    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs" pod "ed7d431e-4bf3-4f61-bc7b-b892be525bd4" (UID: "ed7d431e-4bf3-4f61-bc7b-b892be525bd4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:16:07.920406 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.920376    5872 generic.go:356] "Generic (PLEG): container finished" podID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerID="fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349" exitCode=0
Oct 31 08:16:07.920499 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.920423    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"
Oct 31 08:16:07.920499 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.920463    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" event={"ID":"ed7d431e-4bf3-4f61-bc7b-b892be525bd4","Type":"ContainerDied","Data":"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"}
Oct 31 08:16:07.920573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.920508    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b" event={"ID":"ed7d431e-4bf3-4f61-bc7b-b892be525bd4","Type":"ContainerDied","Data":"cfc357c3c7f6f09a6cd8c9c66af0f4d1057462d98d02a400178416d49983f534"}
Oct 31 08:16:07.920573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.920530    5872 scope.go:122] "RemoveContainer" containerID="fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"
Oct 31 08:16:07.929586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.929570    5872 scope.go:122] "RemoveContainer" containerID="fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"
Oct 31 08:16:07.929860 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:16:07.929842    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349\": container with ID starting with fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349 not found: ID does not exist" containerID="fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"
Oct 31 08:16:07.929908 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.929868    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349"} err="failed to get container status \"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349\": rpc error: code = NotFound desc = could not find container \"fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349\": container with ID starting with fb2a72f6450a55f5db08a5bded19b660532434bb5a5ff4c84dc9f1e507972349 not found: ID does not exist"
Oct 31 08:16:07.965098 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.965078    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:07.965171 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:07.965099    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nhdx\" (UniqueName: \"kubernetes.io/projected/ed7d431e-4bf3-4f61-bc7b-b892be525bd4-kube-api-access-5nhdx\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:08.085033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:08.085002    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:16:08.086717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:08.086689    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebft5b"]
Oct 31 08:16:08.508635 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:08.508603    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" path="/var/lib/kubelet/pods/ed7d431e-4bf3-4f61-bc7b-b892be525bd4/volumes"
Oct 31 08:16:10.526777 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:16:10.526734    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:16:11.845108 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:11.845074    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:16:17.170893 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:17.170854    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:26.864652 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:26.864609    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main" containerID="cri-o://6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e" gracePeriod=45
Oct 31 08:16:27.171400 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:27.171364    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:37.170863 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:37.170827    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:37.171246 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:37.170926    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:16:40.531121 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:16:40.531081    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:16:47.170856 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:47.170816    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:16:57.106905 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.106878    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:16:57.175725 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.175695    5872 generic.go:356] "Generic (PLEG): container finished" podID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerID="6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e" exitCode=0
Oct 31 08:16:57.175862 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.175738    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"
Oct 31 08:16:57.175862 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.175759    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" event={"ID":"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6","Type":"ContainerDied","Data":"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"}
Oct 31 08:16:57.175862 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.175800    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd" event={"ID":"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6","Type":"ContainerDied","Data":"07efc7922751e2b56e3540b94c4cd004cb38b5d1dc7c9eac81d5761ed35b8666"}
Oct 31 08:16:57.175862 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.175821    5872 scope.go:122] "RemoveContainer" containerID="6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"
Oct 31 08:16:57.184183 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.184167    5872 scope.go:122] "RemoveContainer" containerID="6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"
Oct 31 08:16:57.184434 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:16:57.184414    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e\": container with ID starting with 6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e not found: ID does not exist" containerID="6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"
Oct 31 08:16:57.184480 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.184442    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e"} err="failed to get container status \"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e\": rpc error: code = NotFound desc = could not find container \"6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e\": container with ID starting with 6990c58ef7f23ee83fff99bb00ccd4e53d9e01b4a84fe9273c31114f7fa75a5e not found: ID does not exist"
Oct 31 08:16:57.203042 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.203024    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\" (UniqueName: \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\") pod \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") "
Oct 31 08:16:57.203150 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.203136    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\") pod \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\" (UID: \"ef6bd70b-6064-4ee1-8872-3990ce6cf6b6\") "
Oct 31 08:16:57.204904 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.204880    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k" pod "ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" (UID: "ef6bd70b-6064-4ee1-8872-3990ce6cf6b6"). InnerVolumeSpecName "kube-api-access-tpk5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:16:57.205017 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.204960    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs" pod "ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" (UID: "ef6bd70b-6064-4ee1-8872-3990ce6cf6b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:16:57.304425 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.304393    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:57.304425 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.304419    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpk5k\" (UniqueName: \"kubernetes.io/projected/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6-kube-api-access-tpk5k\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:16:57.595092 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.595059    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:16:57.598500 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:57.598475    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8srvd"]
Oct 31 08:16:58.507932 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:16:58.507900    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" path="/var/lib/kubelet/pods/ef6bd70b-6064-4ee1-8872-3990ce6cf6b6/volumes"
Oct 31 08:17:06.534174 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534140    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534500    5872 cpu_manager.go:414] "containerMap: removing container" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main"
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534511    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main"
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534527    5872 cpu_manager.go:414] "containerMap: removing container" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy"
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534532    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy"
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534556    5872 cpu_manager.go:414] "containerMap: removing container" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main"
Oct 31 08:17:06.534577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534561    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main"
Oct 31 08:17:06.534786 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534622    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed7d431e-4bf3-4f61-bc7b-b892be525bd4" containerName="main"
Oct 31 08:17:06.534786 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534633    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef6bd70b-6064-4ee1-8872-3990ce6cf6b6" containerName="main"
Oct 31 08:17:06.534786 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.534640    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7ad1c08-ed22-4673-80fa-e79356f9e1d7" containerName="istio-proxy"
Oct 31 08:17:06.538865 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.538849    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.641701 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.641659    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\""
Oct 31 08:17:06.641865 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.641690    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\""
Oct 31 08:17:06.641865 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.641738    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Oct 31 08:17:06.642226 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.642209    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-4htpt\""
Oct 31 08:17:06.644002 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.643961    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:17:06.693426 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693397    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.693527 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693434    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.693527 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693456    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.693602 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693580    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.693637 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693606    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfw76\" (UniqueName: \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.693739 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.693716    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.794986 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.794883    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfw76\" (UniqueName: \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795145 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.794989    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795145 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795020    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795145 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795045    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795145 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795069    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795145 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795104    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795469 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795445    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795534 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795478    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.795534 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.795512    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.797376 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.797353    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.797671 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.797650    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.850819 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.850796    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfw76\" (UniqueName: \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:06.851592 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:06.851564    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:07.089207 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.089138    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:17:07.092858 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.092841    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.148072 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.148043    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-n2vt4\""
Oct 31 08:17:07.150197 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.150171    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:17:07.198578 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.198551    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.198716 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.198621    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krff7\" (UniqueName: \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.261672 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.261642    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:17:07.264446 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:17:07.264410    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c965f7_949c_4a5a_9b93_92f2cc1fdbe6.slice/crio-1a26253f791bc30a5c6931d1d2338dff0416e31d901f07c32cebe1dbd18bcc41 WatchSource:0}: Error finding container 1a26253f791bc30a5c6931d1d2338dff0416e31d901f07c32cebe1dbd18bcc41: Status 404 returned error can't find the container with id 1a26253f791bc30a5c6931d1d2338dff0416e31d901f07c32cebe1dbd18bcc41
Oct 31 08:17:07.299408 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.299384    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krff7\" (UniqueName: \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.299529 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.299471    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.302278 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.302257    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.359139 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.359070    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krff7\" (UniqueName: \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.406353 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.406323    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:07.775205 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:07.775177    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:17:07.777249 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:17:07.777221    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e148863_17f9_45bf_a1d0_3da258ced0ac.slice/crio-7d82d60e5a1e6ecc4e993cee72ba52bbb8b7d21c37f19fce2fcdcec675352b70 WatchSource:0}: Error finding container 7d82d60e5a1e6ecc4e993cee72ba52bbb8b7d21c37f19fce2fcdcec675352b70: Status 404 returned error can't find the container with id 7d82d60e5a1e6ecc4e993cee72ba52bbb8b7d21c37f19fce2fcdcec675352b70
Oct 31 08:17:08.240438 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.240402    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" event={"ID":"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6","Type":"ContainerStarted","Data":"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"}
Oct 31 08:17:08.240703 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.240459    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" event={"ID":"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6","Type":"ContainerStarted","Data":"1a26253f791bc30a5c6931d1d2338dff0416e31d901f07c32cebe1dbd18bcc41"}
Oct 31 08:17:08.242092 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.242065    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" event={"ID":"4e148863-17f9-45bf-a1d0-3da258ced0ac","Type":"ContainerStarted","Data":"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"}
Oct 31 08:17:08.242204 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.242112    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" event={"ID":"4e148863-17f9-45bf-a1d0-3da258ced0ac","Type":"ContainerStarted","Data":"7d82d60e5a1e6ecc4e993cee72ba52bbb8b7d21c37f19fce2fcdcec675352b70"}
Oct 31 08:17:08.242204 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.242132    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:08.354542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.354484    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" podStartSLOduration=2.35447044 podStartE2EDuration="2.35447044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:17:08.353671415 +0000 UTC m=+2837.965881157" watchObservedRunningTime="2026-10-31 08:17:08.35447044 +0000 UTC m=+2837.966680182"
Oct 31 08:17:08.468627 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.467411    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podStartSLOduration=1.467390778 podStartE2EDuration="1.467390778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:17:08.466210695 +0000 UTC m=+2838.078420443" watchObservedRunningTime="2026-10-31 08:17:08.467390778 +0000 UTC m=+2838.079600521"
Oct 31 08:17:08.852545 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:08.852514    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:10.543125 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:17:10.543070    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:17:16.851920 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:16.851879    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:16.864879 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:16.864855    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:17.298667 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:17.298638    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:17:39.249840 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:39.249810    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:17:40.529785 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:17:40.529746    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:17:53.461092 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.461057    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:17:53.465793 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.465771    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.522539 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.522503    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:17:53.543797 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.543772    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-bfmzq\""
Oct 31 08:17:53.569573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.569544    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Oct 31 08:17:53.625328 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.625290    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lznq8\" (UniqueName: \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.625501 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.625347    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.726626 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.726540    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lznq8\" (UniqueName: \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.726626 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.726586    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.729126 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.729099    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:53.783226 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:53.783196    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lznq8\" (UniqueName: \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:54.078346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:54.078253    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:54.451257 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:54.451230    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:17:54.453476 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:17:54.453435    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3848f95b_eef4_4ecc_a0ca_95c3784fc035.slice/crio-718188fdafc243cffe33d4861856bbdb3970c8a02d04fe9013dab1c3b75e82a2 WatchSource:0}: Error finding container 718188fdafc243cffe33d4861856bbdb3970c8a02d04fe9013dab1c3b75e82a2: Status 404 returned error can't find the container with id 718188fdafc243cffe33d4861856bbdb3970c8a02d04fe9013dab1c3b75e82a2
Oct 31 08:17:54.491125 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:54.491098    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" event={"ID":"3848f95b-eef4-4ecc-a0ca-95c3784fc035","Type":"ContainerStarted","Data":"718188fdafc243cffe33d4861856bbdb3970c8a02d04fe9013dab1c3b75e82a2"}
Oct 31 08:17:55.497734 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:55.497696    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" event={"ID":"3848f95b-eef4-4ecc-a0ca-95c3784fc035","Type":"ContainerStarted","Data":"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"}
Oct 31 08:17:55.498184 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:55.497796    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:17:55.612172 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:17:55.612112    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podStartSLOduration=2.612099083 podStartE2EDuration="2.612099083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:17:55.610189985 +0000 UTC m=+2885.222399729" watchObservedRunningTime="2026-10-31 08:17:55.612099083 +0000 UTC m=+2885.224308824"
Oct 31 08:18:10.528512 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:18:10.528438    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:18:26.508651 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:26.508616    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:18:32.929779 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:32.929743    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:18:36.504783 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:36.504744    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:18:40.527832 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:18:40.527792    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:18:46.504616 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:46.504568    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:18:47.949647 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:47.949604    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" containerID="cri-o://a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7" gracePeriod=45
Oct 31 08:18:56.504526 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:56.504487    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:18:56.508291 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:18:56.508270    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:19:06.505167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:06.505130    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:19:10.528181 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:10.528143    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:19:16.504686 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:16.504641    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:19:18.195434 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.195400    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:19:18.310175 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.310100    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\" (UniqueName: \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\") pod \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") "
Oct 31 08:19:18.310343 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.310228    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\" (UniqueName: \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\") pod \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\" (UID: \"3848f95b-eef4-4ecc-a0ca-95c3784fc035\") "
Oct 31 08:19:18.312552 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.312523    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs" pod "3848f95b-eef4-4ecc-a0ca-95c3784fc035" (UID: "3848f95b-eef4-4ecc-a0ca-95c3784fc035"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:19:18.312652 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.312545    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8" pod "3848f95b-eef4-4ecc-a0ca-95c3784fc035" (UID: "3848f95b-eef4-4ecc-a0ca-95c3784fc035"). InnerVolumeSpecName "kube-api-access-lznq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:19:18.411866 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.411835    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lznq8\" (UniqueName: \"kubernetes.io/projected/3848f95b-eef4-4ecc-a0ca-95c3784fc035-kube-api-access-lznq8\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:18.411866 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.411863    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3848f95b-eef4-4ecc-a0ca-95c3784fc035-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:18.934390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.934352    5872 generic.go:356] "Generic (PLEG): container finished" podID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerID="a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7" exitCode=0
Oct 31 08:19:18.934598 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.934399    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"
Oct 31 08:19:18.934598 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.934442    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" event={"ID":"3848f95b-eef4-4ecc-a0ca-95c3784fc035","Type":"ContainerDied","Data":"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"}
Oct 31 08:19:18.934598 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.934499    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk" event={"ID":"3848f95b-eef4-4ecc-a0ca-95c3784fc035","Type":"ContainerDied","Data":"718188fdafc243cffe33d4861856bbdb3970c8a02d04fe9013dab1c3b75e82a2"}
Oct 31 08:19:18.934598 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.934528    5872 scope.go:122] "RemoveContainer" containerID="a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"
Oct 31 08:19:18.943222 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.943201    5872 scope.go:122] "RemoveContainer" containerID="a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"
Oct 31 08:19:18.943473 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:18.943458    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7\": container with ID starting with a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7 not found: ID does not exist" containerID="a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"
Oct 31 08:19:18.943514 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:18.943484    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7"} err="failed to get container status \"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7\": rpc error: code = NotFound desc = could not find container \"a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7\": container with ID starting with a4a878511176a0b1c5ae83611d6e0f29f4ba239583611e859d59bac71a70aea7 not found: ID does not exist"
Oct 31 08:19:19.096162 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:19.096119    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:19:19.145849 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:19.145818    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schensddk"]
Oct 31 08:19:20.508666 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:20.508631    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" path="/var/lib/kubelet/pods/3848f95b-eef4-4ecc-a0ca-95c3784fc035/volumes"
Oct 31 08:19:21.431641 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.431604    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:19:21.451135 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.451103    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:19:21.459526 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:21.459493    5872 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788" cmd=["/bin/sleep","15"]
Oct 31 08:19:21.459652 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.459543    5872 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 08:19:21.459652 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:21.459556    5872 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerName="main" containerID="cri-o://205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"
Oct 31 08:19:21.459652 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.459599    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerName="main" containerID="cri-o://205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788" gracePeriod=60
Oct 31 08:19:21.815652 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.815620    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:19:21.945281 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945253    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945307    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945350    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945395    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\" (UniqueName: \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945419    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945691 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945471    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\") pod \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\" (UID: \"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6\") "
Oct 31 08:19:21.945691 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945575    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:19:21.945691 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945624    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:19:21.945829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945789    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:19:21.945886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945841    5872 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-home\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:21.945886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.945862    5872 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tmp-dir\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:21.947756 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.947734    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:19:21.948059 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.948040    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:19:21.961637 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.961077    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76" pod "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" (UID: "71c965f7-949c-4a5a-9b93-92f2cc1fdbe6"). InnerVolumeSpecName "kube-api-access-bfw76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:19:21.962651 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.962618    5872 generic.go:356] "Generic (PLEG): container finished" podID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerID="205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788" exitCode=0
Oct 31 08:19:21.962767 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.962684    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"
Oct 31 08:19:21.962767 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.962700    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" event={"ID":"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6","Type":"ContainerDied","Data":"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"}
Oct 31 08:19:21.962897 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.962796    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q" event={"ID":"71c965f7-949c-4a5a-9b93-92f2cc1fdbe6","Type":"ContainerDied","Data":"1a26253f791bc30a5c6931d1d2338dff0416e31d901f07c32cebe1dbd18bcc41"}
Oct 31 08:19:21.962897 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.962825    5872 scope.go:122] "RemoveContainer" containerID="205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"
Oct 31 08:19:21.972719 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.972704    5872 scope.go:122] "RemoveContainer" containerID="205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"
Oct 31 08:19:21.972960 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:21.972940    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788\": container with ID starting with 205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788 not found: ID does not exist" containerID="205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"
Oct 31 08:19:21.973032 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:21.972983    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788"} err="failed to get container status \"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788\": rpc error: code = NotFound desc = could not find container \"205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788\": container with ID starting with 205390aa0e2726f8a8d6c47a9ced6703093fd3d9f02b3b007c9d1e2d26c7b788 not found: ID does not exist"
Oct 31 08:19:22.046603 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.046510    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:22.046603 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.046542    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfw76\" (UniqueName: \"kubernetes.io/projected/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-kube-api-access-bfw76\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:22.046603 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.046556    5872 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-dshm\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:22.046603 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.046569    5872 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6-model-cache\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:19:22.124867 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.124828    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:19:22.128131 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.128105    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-nt45q"]
Oct 31 08:19:22.508722 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:22.508694    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" path="/var/lib/kubelet/pods/71c965f7-949c-4a5a-9b93-92f2cc1fdbe6/volumes"
Oct 31 08:19:29.249784 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:29.249699    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:19:36.451621 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:36.451559    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main" containerID="cri-o://c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488" gracePeriod=45
Oct 31 08:19:39.249809 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:39.249765    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:19:40.527668 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:19:40.527626    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:19:49.249595 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:49.249558    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:19:49.250010 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:49.249667    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:19:50.888544 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:50.888517    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:19:50.898494 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:50.898469    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:19:50.906293 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:50.906271    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:19:50.915669 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:50.915650    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:19:59.249164 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:19:59.249123    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:20:06.705703 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.705673    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:20:06.836670 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.836588    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\") pod \"4e148863-17f9-45bf-a1d0-3da258ced0ac\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") "
Oct 31 08:20:06.836834 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.836703    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\" (UniqueName: \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\") pod \"4e148863-17f9-45bf-a1d0-3da258ced0ac\" (UID: \"4e148863-17f9-45bf-a1d0-3da258ced0ac\") "
Oct 31 08:20:06.838781 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.838746    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7" pod "4e148863-17f9-45bf-a1d0-3da258ced0ac" (UID: "4e148863-17f9-45bf-a1d0-3da258ced0ac"). InnerVolumeSpecName "kube-api-access-krff7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:20:06.838781 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.838748    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs" pod "4e148863-17f9-45bf-a1d0-3da258ced0ac" (UID: "4e148863-17f9-45bf-a1d0-3da258ced0ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:20:06.944536 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.938936    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e148863-17f9-45bf-a1d0-3da258ced0ac-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:20:06.944536 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:06.939005    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krff7\" (UniqueName: \"kubernetes.io/projected/4e148863-17f9-45bf-a1d0-3da258ced0ac-kube-api-access-krff7\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:20:07.188757 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.188717    5872 generic.go:356] "Generic (PLEG): container finished" podID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerID="c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488" exitCode=0
Oct 31 08:20:07.188937 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.188766    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" event={"ID":"4e148863-17f9-45bf-a1d0-3da258ced0ac","Type":"ContainerDied","Data":"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"}
Oct 31 08:20:07.188937 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.188790    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"
Oct 31 08:20:07.188937 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.188847    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx" event={"ID":"4e148863-17f9-45bf-a1d0-3da258ced0ac","Type":"ContainerDied","Data":"7d82d60e5a1e6ecc4e993cee72ba52bbb8b7d21c37f19fce2fcdcec675352b70"}
Oct 31 08:20:07.188937 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.188877    5872 scope.go:122] "RemoveContainer" containerID="c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"
Oct 31 08:20:07.198638 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.198616    5872 scope.go:122] "RemoveContainer" containerID="c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"
Oct 31 08:20:07.198940 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:20:07.198918    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488\": container with ID starting with c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488 not found: ID does not exist" containerID="c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"
Oct 31 08:20:07.199008 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.198950    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488"} err="failed to get container status \"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488\": rpc error: code = NotFound desc = could not find container \"c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488\": container with ID starting with c3a9473b8e6aa91ac3fbba5f45f9085cad6d3c3bfe1e0c5986311586d4848488 not found: ID does not exist"
Oct 31 08:20:07.352258 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.352216    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:20:07.355512 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:07.355482    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep2pxx"]
Oct 31 08:20:08.508426 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:08.508391    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" path="/var/lib/kubelet/pods/4e148863-17f9-45bf-a1d0-3da258ced0ac/volumes"
Oct 31 08:20:10.527675 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:20:10.527635    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:20:19.799609 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.799573    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.799959    5872 cpu_manager.go:414] "containerMap: removing container" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main"
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.799983    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main"
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800005    5872 cpu_manager.go:414] "containerMap: removing container" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main"
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800010    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main"
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800029    5872 cpu_manager.go:414] "containerMap: removing container" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerName="main"
Oct 31 08:20:19.800063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800034    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerName="main"
Oct 31 08:20:19.800255 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800087    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="3848f95b-eef4-4ecc-a0ca-95c3784fc035" containerName="main"
Oct 31 08:20:19.800255 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800098    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="71c965f7-949c-4a5a-9b93-92f2cc1fdbe6" containerName="main"
Oct 31 08:20:19.800255 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.800106    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e148863-17f9-45bf-a1d0-3da258ced0ac" containerName="main"
Oct 31 08:20:19.803159 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.803143    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:19.857022 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.856986    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:19.857154 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.857140    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zph\" (UniqueName: \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:19.858208 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.858176    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\""
Oct 31 08:20:19.860375 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.860351    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:20:19.877226 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.877207    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\""
Oct 31 08:20:19.907687 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.907663    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-gzt6x\""
Oct 31 08:20:19.907825 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.907804    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-dpgxv\""
Oct 31 08:20:19.907876 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.907842    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Oct 31 08:20:19.958363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.958327    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zph\" (UniqueName: \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:19.958526 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.958375    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:19.960943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:19.960921    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:20.014866 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:20.014840    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zph\" (UniqueName: \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:20.116202 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:20.116112    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:20.483755 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:20.483727    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:20:20.486419 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:20:20.486389    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f5ad90_d58b_457a_8743_582facf3c658.slice/crio-fb2cd40e0ef6ecf9f0962317e97a1046acbbdbeaa59bb7d2d5b9ba82e2a344c3 WatchSource:0}: Error finding container fb2cd40e0ef6ecf9f0962317e97a1046acbbdbeaa59bb7d2d5b9ba82e2a344c3: Status 404 returned error can't find the container with id fb2cd40e0ef6ecf9f0962317e97a1046acbbdbeaa59bb7d2d5b9ba82e2a344c3
Oct 31 08:20:21.258789 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:21.258751    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" event={"ID":"15f5ad90-d58b-457a-8743-582facf3c658","Type":"ContainerStarted","Data":"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"}
Oct 31 08:20:21.259221 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:21.258805    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" event={"ID":"15f5ad90-d58b-457a-8743-582facf3c658","Type":"ContainerStarted","Data":"fb2cd40e0ef6ecf9f0962317e97a1046acbbdbeaa59bb7d2d5b9ba82e2a344c3"}
Oct 31 08:20:21.259221 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:21.258912    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:20:21.373581 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:21.373518    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podStartSLOduration=2.373505455 podStartE2EDuration="2.373505455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:20:21.371948134 +0000 UTC m=+3030.984157877" watchObservedRunningTime="2026-10-31 08:20:21.373505455 +0000 UTC m=+3030.985715196"
Oct 31 08:20:40.526539 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:20:40.526502    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:20:52.265449 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:20:52.265422    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:21:10.533565 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:21:10.533478    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:21:40.529394 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:21:40.529356    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:22:10.528045 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:22:10.528003    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:22:36.555133 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:22:36.555094    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:22:40.527488 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:22:40.527454    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:22:42.266194 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:22:42.266153    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:22:51.575486 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:22:51.575449    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main" containerID="cri-o://c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887" gracePeriod=45
Oct 31 08:22:52.266076 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:22:52.266028    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:23:02.265377 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:02.265334    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:23:02.265946 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:02.265464    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:23:10.527444 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:23:10.527409    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:23:12.266063 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:12.266026    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:23:21.829470 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.829445    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:23:21.876651 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.876592    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\" (UniqueName: \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\") pod \"15f5ad90-d58b-457a-8743-582facf3c658\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") "
Oct 31 08:23:21.876765 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.876730    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\" (UniqueName: \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\") pod \"15f5ad90-d58b-457a-8743-582facf3c658\" (UID: \"15f5ad90-d58b-457a-8743-582facf3c658\") "
Oct 31 08:23:21.878573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.878547    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs" pod "15f5ad90-d58b-457a-8743-582facf3c658" (UID: "15f5ad90-d58b-457a-8743-582facf3c658"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:23:21.878662 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.878638    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph" pod "15f5ad90-d58b-457a-8743-582facf3c658" (UID: "15f5ad90-d58b-457a-8743-582facf3c658"). InnerVolumeSpecName "kube-api-access-s5zph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:23:21.977680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.977648    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15f5ad90-d58b-457a-8743-582facf3c658-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:23:21.977680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:21.977678    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5zph\" (UniqueName: \"kubernetes.io/projected/15f5ad90-d58b-457a-8743-582facf3c658-kube-api-access-s5zph\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:23:22.178759 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.178729    5872 generic.go:356] "Generic (PLEG): container finished" podID="15f5ad90-d58b-457a-8743-582facf3c658" containerID="c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887" exitCode=0
Oct 31 08:23:22.178929 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.178775    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"
Oct 31 08:23:22.178929 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.178820    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" event={"ID":"15f5ad90-d58b-457a-8743-582facf3c658","Type":"ContainerDied","Data":"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"}
Oct 31 08:23:22.178929 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.178881    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b" event={"ID":"15f5ad90-d58b-457a-8743-582facf3c658","Type":"ContainerDied","Data":"fb2cd40e0ef6ecf9f0962317e97a1046acbbdbeaa59bb7d2d5b9ba82e2a344c3"}
Oct 31 08:23:22.178929 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.178903    5872 scope.go:122] "RemoveContainer" containerID="c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"
Oct 31 08:23:22.188494 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.188477    5872 scope.go:122] "RemoveContainer" containerID="c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"
Oct 31 08:23:22.188741 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:23:22.188720    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887\": container with ID starting with c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887 not found: ID does not exist" containerID="c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"
Oct 31 08:23:22.188795 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.188749    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887"} err="failed to get container status \"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887\": rpc error: code = NotFound desc = could not find container \"c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887\": container with ID starting with c352bbdfbd04fb4e07c018b469366e432fd82a38744dd21ae2026ddd78d0b887 not found: ID does not exist"
Oct 31 08:23:22.342249 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.342210    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:23:22.392567 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.392531    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schemrx7b"]
Oct 31 08:23:22.508176 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:22.508093    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15f5ad90-d58b-457a-8743-582facf3c658" path="/var/lib/kubelet/pods/15f5ad90-d58b-457a-8743-582facf3c658/volumes"
Oct 31 08:23:31.470832 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.470788    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:23:31.471433 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.471411    5872 cpu_manager.go:414] "containerMap: removing container" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main"
Oct 31 08:23:31.471516 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.471435    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main"
Oct 31 08:23:31.471573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.471543    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="15f5ad90-d58b-457a-8743-582facf3c658" containerName="main"
Oct 31 08:23:31.475868 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.475846    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.567004 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.566959    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8sl\" (UniqueName: \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.567170 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.567107    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.569863 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.569843    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"kube-root-ca.crt\""
Oct 31 08:23:31.571670 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.571649    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:23:31.578586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.578563    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"openshift-service-ca.crt\""
Oct 31 08:23:31.578717 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.578668    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"default-dockercfg-hgk7x\""
Oct 31 08:23:31.578769 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.578742    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\""
Oct 31 08:23:31.578856 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.578837    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-g5m6j\""
Oct 31 08:23:31.668285 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.668242    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8sl\" (UniqueName: \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.668474 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.668342    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.671067 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.671046    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.725544 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.725471    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8sl\" (UniqueName: \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:31.788254 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:31.788220    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:32.158289 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:32.158265    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:23:32.160778 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:23:32.160751    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0787f099_302a_423c_a990_e43ffc40c5fb.slice/crio-8f796af29b5babe9bc1500b5f7100a51807da076d34e94cbd7c09d37be972fca WatchSource:0}: Error finding container 8f796af29b5babe9bc1500b5f7100a51807da076d34e94cbd7c09d37be972fca: Status 404 returned error can't find the container with id 8f796af29b5babe9bc1500b5f7100a51807da076d34e94cbd7c09d37be972fca
Oct 31 08:23:32.232700 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:32.232672    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" event={"ID":"0787f099-302a-423c-a990-e43ffc40c5fb","Type":"ContainerStarted","Data":"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"}
Oct 31 08:23:32.232843 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:32.232720    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" event={"ID":"0787f099-302a-423c-a990-e43ffc40c5fb","Type":"ContainerStarted","Data":"8f796af29b5babe9bc1500b5f7100a51807da076d34e94cbd7c09d37be972fca"}
Oct 31 08:23:32.232843 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:32.232756    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:23:32.346057 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:32.345999    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podStartSLOduration=1.345962979 podStartE2EDuration="1.345962979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:23:32.345763951 +0000 UTC m=+3221.957973699" watchObservedRunningTime="2026-10-31 08:23:32.345962979 +0000 UTC m=+3221.958172721"
Oct 31 08:23:40.544451 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:23:40.540931    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:23:48.591740 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.591705    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:23:48.595353 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.595337    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605424 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605400    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605539 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605437    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605539 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605465    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605660 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605619    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605760 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605702    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605760 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605743    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.605935 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605919    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.606014 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.605950    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvz7\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.606128 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.606109    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.700719 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.700679    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:23:48.706777 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706754    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.706846 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706800    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.706846 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706820    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.706846 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706843    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707024 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706870    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707024 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706886    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707024 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706911    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707024 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.706989    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707235 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.707025    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvz7\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707293 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.707226    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707349 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.707288    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707449 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.707417    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.707556 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.707427    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.708068 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.708041    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.709573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.709552    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.709830 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.709813    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.763425 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.763393    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvz7\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.763575 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.763402    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-ns26s\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:48.908877 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:48.908789    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:49.330779 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.330750    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:23:49.332765 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:23:49.332740    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8af6a36_046f_4f33_98c6_63cd1edb53d3.slice/crio-9a81d3efcbf9d4b7e2586f05d466b2866c49e7fd5c463fbd2fd1eb2959d1cd98 WatchSource:0}: Error finding container 9a81d3efcbf9d4b7e2586f05d466b2866c49e7fd5c463fbd2fd1eb2959d1cd98: Status 404 returned error can't find the container with id 9a81d3efcbf9d4b7e2586f05d466b2866c49e7fd5c463fbd2fd1eb2959d1cd98
Oct 31 08:23:49.335032 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.334993    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:23:49.335109 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.335070    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:23:49.335109 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.335102    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:23:49.432822 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.432786    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" event={"ID":"d8af6a36-046f-4f33-98c6-63cd1edb53d3","Type":"ContainerStarted","Data":"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"}
Oct 31 08:23:49.433046 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.432852    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" event={"ID":"d8af6a36-046f-4f33-98c6-63cd1edb53d3","Type":"ContainerStarted","Data":"9a81d3efcbf9d4b7e2586f05d466b2866c49e7fd5c463fbd2fd1eb2959d1cd98"}
Oct 31 08:23:49.553082 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.553027    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podStartSLOduration=1.553012742 podStartE2EDuration="1.553012742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:23:49.551348423 +0000 UTC m=+3239.163558166" watchObservedRunningTime="2026-10-31 08:23:49.553012742 +0000 UTC m=+3239.165222484"
Oct 31 08:23:49.909668 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:49.909634    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:50.911337 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:50.911303    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 08:23:50.911708 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:50.911353    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 08:23:51.909770 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:51.909731    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 08:23:51.910006 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:51.909809    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 08:23:52.910141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:52.910100    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 08:23:52.910547 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:52.910199    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 08:23:53.909985 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:53.909934    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 08:23:53.910156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:53.910013    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 08:23:54.909800 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:54.909763    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 08:23:54.910219 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:54.909819    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 08:23:55.914086 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:55.914051    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:55.914457 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:55.914408    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:23:55.915181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:23:55.915165    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:24:03.239579 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:03.239492    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:24:10.528545 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:24:10.528509    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:24:40.527910 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:24:40.527871    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:24:50.925996 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:50.925954    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:24:50.937500 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:50.937478    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:24:50.943704 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:50.943683    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:24:50.958376 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:50.958355    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:24:58.592629 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.592591    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:24:58.663548 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.663516    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:24:58.667216 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.667198    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.674057 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.674033    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.674130 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.674077    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926lr\" (UniqueName: \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.721267 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.721227    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"default-dockercfg-wvx2n\""
Oct 31 08:24:58.723624 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.723591    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:24:58.723919 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.723898    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa-dockercfg-jhmr4\""
Oct 31 08:24:58.755832 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.755800    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Oct 31 08:24:58.756066 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.755806    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"kube-root-ca.crt\""
Oct 31 08:24:58.756066 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.755813    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"openshift-service-ca.crt\""
Oct 31 08:24:58.775212 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.775186    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.775328 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.775219    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926lr\" (UniqueName: \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.777596 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.777574    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.838473 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.838452    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-926lr\" (UniqueName: \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:58.986725 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:58.986690    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:59.357378 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:59.357331    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:24:59.359838 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:24:59.359801    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7dbd0db_5492_4bc5_ae41_bc27589836ce.slice/crio-675bdc8750d752865ebbf7376b240bdba5cd8a3826832242ef7d59f92068f226 WatchSource:0}: Error finding container 675bdc8750d752865ebbf7376b240bdba5cd8a3826832242ef7d59f92068f226: Status 404 returned error can't find the container with id 675bdc8750d752865ebbf7376b240bdba5cd8a3826832242ef7d59f92068f226
Oct 31 08:24:59.810454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:59.810413    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" event={"ID":"f7dbd0db-5492-4bc5-ae41-bc27589836ce","Type":"ContainerStarted","Data":"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"}
Oct 31 08:24:59.810904 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:59.810480    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" event={"ID":"f7dbd0db-5492-4bc5-ae41-bc27589836ce","Type":"ContainerStarted","Data":"675bdc8750d752865ebbf7376b240bdba5cd8a3826832242ef7d59f92068f226"}
Oct 31 08:24:59.810904 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:59.810510    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:24:59.924625 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:24:59.924569    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podStartSLOduration=1.924553454 podStartE2EDuration="1.924553454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:24:59.92273903 +0000 UTC m=+3309.534948797" watchObservedRunningTime="2026-10-31 08:24:59.924553454 +0000 UTC m=+3309.536763197"
Oct 31 08:25:03.240083 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:03.240036    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:25:10.528059 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:25:10.528023    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:25:13.240082 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:13.240045    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:25:13.612825 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:13.612715    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" containerID="cri-o://0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea" gracePeriod=45
Oct 31 08:25:23.239831 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:23.239792    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:25:23.240238 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:23.239904    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:25:30.817573 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:30.817531    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:25:33.239882 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:33.239846    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:25:40.528209 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:25:40.528174    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:25:43.239779 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.239732    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:25:43.868626 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.868601    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:25:43.898781 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.898727    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\") pod \"0787f099-302a-423c-a990-e43ffc40c5fb\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") "
Oct 31 08:25:43.898880 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.898795    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\" (UniqueName: \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\") pod \"0787f099-302a-423c-a990-e43ffc40c5fb\" (UID: \"0787f099-302a-423c-a990-e43ffc40c5fb\") "
Oct 31 08:25:43.900861 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.900833    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs" pod "0787f099-302a-423c-a990-e43ffc40c5fb" (UID: "0787f099-302a-423c-a990-e43ffc40c5fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:25:43.900951 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:43.900876    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl" pod "0787f099-302a-423c-a990-e43ffc40c5fb" (UID: "0787f099-302a-423c-a990-e43ffc40c5fb"). InnerVolumeSpecName "kube-api-access-5k8sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:25:44.000122 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.000087    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787f099-302a-423c-a990-e43ffc40c5fb-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:25:44.000122 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.000116    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k8sl\" (UniqueName: \"kubernetes.io/projected/0787f099-302a-423c-a990-e43ffc40c5fb-kube-api-access-5k8sl\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:25:44.039605 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.039571    5872 generic.go:356] "Generic (PLEG): container finished" podID="0787f099-302a-423c-a990-e43ffc40c5fb" containerID="0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea" exitCode=0
Oct 31 08:25:44.039761 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.039627    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"
Oct 31 08:25:44.039761 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.039659    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" event={"ID":"0787f099-302a-423c-a990-e43ffc40c5fb","Type":"ContainerDied","Data":"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"}
Oct 31 08:25:44.039761 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.039715    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7" event={"ID":"0787f099-302a-423c-a990-e43ffc40c5fb","Type":"ContainerDied","Data":"8f796af29b5babe9bc1500b5f7100a51807da076d34e94cbd7c09d37be972fca"}
Oct 31 08:25:44.039761 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.039741    5872 scope.go:122] "RemoveContainer" containerID="0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"
Oct 31 08:25:44.048906 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.048885    5872 scope.go:122] "RemoveContainer" containerID="0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"
Oct 31 08:25:44.049203 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:25:44.049184    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea\": container with ID starting with 0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea not found: ID does not exist" containerID="0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"
Oct 31 08:25:44.049259 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.049212    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea"} err="failed to get container status \"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea\": rpc error: code = NotFound desc = could not find container \"0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea\": container with ID starting with 0fb83193db6361ef9958f5ef567120999b03cfe41c1e784d96289875ed6711ea not found: ID does not exist"
Oct 31 08:25:44.203105 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.203070    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:25:44.204732 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.204710    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel2gv7"]
Oct 31 08:25:44.509018 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:44.508937    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" path="/var/lib/kubelet/pods/0787f099-302a-423c-a990-e43ffc40c5fb/volumes"
Oct 31 08:25:52.105500 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.105462    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:25:52.105901 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.105842    5872 cpu_manager.go:414] "containerMap: removing container" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main"
Oct 31 08:25:52.105901 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.105854    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main"
Oct 31 08:25:52.106027 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.105986    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="0787f099-302a-423c-a990-e43ffc40c5fb" containerName="main"
Oct 31 08:25:52.110264 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.110246    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.163245 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.163183    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\""
Oct 31 08:25:52.171760 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.171729    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.171888 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.171796    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8v4r\" (UniqueName: \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.201023 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.200996    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\""
Oct 31 08:25:52.212896 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.212873    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\""
Oct 31 08:25:52.212896 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.212875    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-fwsxf\""
Oct 31 08:25:52.213091 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.212932    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-cpsgt\""
Oct 31 08:25:52.214846 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.214823    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:25:52.273325 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.273293    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8v4r\" (UniqueName: \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.278470 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.273459    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.278470 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.277604    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.330447 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.330413    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8v4r\" (UniqueName: \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.423334 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.423305    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:52.793096 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:52.793069    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:25:52.795152 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:25:52.795128    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf834f2e_85eb_4d88_a0df_fa2ba7b543dc.slice/crio-33bc5f15bf994a108129c71a93a2af96f3d6f14267c5223780fcad89bd47c885 WatchSource:0}: Error finding container 33bc5f15bf994a108129c71a93a2af96f3d6f14267c5223780fcad89bd47c885: Status 404 returned error can't find the container with id 33bc5f15bf994a108129c71a93a2af96f3d6f14267c5223780fcad89bd47c885
Oct 31 08:25:53.089800 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:53.089716    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" event={"ID":"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc","Type":"ContainerStarted","Data":"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"}
Oct 31 08:25:53.089800 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:53.089765    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" event={"ID":"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc","Type":"ContainerStarted","Data":"33bc5f15bf994a108129c71a93a2af96f3d6f14267c5223780fcad89bd47c885"}
Oct 31 08:25:53.090013 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:53.089849    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:25:53.202651 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:25:53.202598    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podStartSLOduration=1.202580976 podStartE2EDuration="1.202580976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:25:53.202425567 +0000 UTC m=+3362.814635309" watchObservedRunningTime="2026-10-31 08:25:53.202580976 +0000 UTC m=+3362.814790720"
Oct 31 08:26:10.527577 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:26:10.527541    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:26:24.096581 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:26:24.096550    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:26:40.533621 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:26:40.533579    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:27:10.529348 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:27:10.529251    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:27:40.527116 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:27:40.527077    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:27:48.913239 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:27:48.913202    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:27:54.096839 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:27:54.096799    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:03.933026 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:03.932989    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" containerID="cri-o://aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da" gracePeriod=45
Oct 31 08:28:04.096612 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:04.096569    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:06.090193 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:06.090159    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:28:10.528165 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:28:10.528125    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:28:10.817350 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:10.817272    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:14.096224 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:14.096187    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:14.096600 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:14.096315    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:28:20.818203 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:20.818157    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:21.110722 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:21.110621    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" containerID="cri-o://d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8" gracePeriod=45
Oct 31 08:28:24.096661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:24.096619    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:30.817825 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:30.817740    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:30.818304 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:30.817840    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:28:34.095543 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:28:34.095518    5872 logging.go:55] [core] [Channel #1169 SubChannel #1170]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.74:9003", ServerName: "10.134.0.74:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.74:9003: connect: connection refused"
Oct 31 08:28:34.194256 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.194203    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:28:34.295414 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.295386    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\") pod \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") "
Oct 31 08:28:34.295576 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.295458    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\" (UniqueName: \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\") pod \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\" (UID: \"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc\") "
Oct 31 08:28:34.297577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.297546    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs" pod "cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" (UID: "cf834f2e-85eb-4d88-a0df-fa2ba7b543dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:28:34.297688 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.297631    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r" pod "cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" (UID: "cf834f2e-85eb-4d88-a0df-fa2ba7b543dc"). InnerVolumeSpecName "kube-api-access-q8v4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:28:34.397122 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.397088    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8v4r\" (UniqueName: \"kubernetes.io/projected/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-kube-api-access-q8v4r\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:28:34.397122 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.397118    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:28:34.918205 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.918172    5872 generic.go:356] "Generic (PLEG): container finished" podID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerID="aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da" exitCode=0
Oct 31 08:28:34.918373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.918222    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"
Oct 31 08:28:34.918373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.918257    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" event={"ID":"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc","Type":"ContainerDied","Data":"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"}
Oct 31 08:28:34.918373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.918311    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" event={"ID":"cf834f2e-85eb-4d88-a0df-fa2ba7b543dc","Type":"ContainerDied","Data":"33bc5f15bf994a108129c71a93a2af96f3d6f14267c5223780fcad89bd47c885"}
Oct 31 08:28:34.918373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.918333    5872 scope.go:122] "RemoveContainer" containerID="aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"
Oct 31 08:28:34.926949 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.926923    5872 scope.go:122] "RemoveContainer" containerID="aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"
Oct 31 08:28:34.927229 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:28:34.927211    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da\": container with ID starting with aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da not found: ID does not exist" containerID="aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"
Oct 31 08:28:34.927281 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:34.927237    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da"} err="failed to get container status \"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da\": rpc error: code = NotFound desc = could not find container \"aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da\": container with ID starting with aeaf732d053a4b0a36d631825c5a7cd224156e3f7222590a2bd8a859b18356da not found: ID does not exist"
Oct 31 08:28:35.083537 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:35.083445    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:28:35.095734 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:35.095702    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.74:9003\" within 1s: context deadline exceeded"
Oct 31 08:28:35.133365 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:35.133329    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-pd7ll"]
Oct 31 08:28:36.509301 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:36.509263    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" path="/var/lib/kubelet/pods/cf834f2e-85eb-4d88-a0df-fa2ba7b543dc/volumes"
Oct 31 08:28:40.527423 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:28:40.527387    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:28:40.818065 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:40.817988    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:50.817439 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:50.817400    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:28:51.355519 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.355492    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:28:51.458452 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.458421    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\" (UniqueName: \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\") pod \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") "
Oct 31 08:28:51.458628 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.458475    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\") pod \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\" (UID: \"f7dbd0db-5492-4bc5-ae41-bc27589836ce\") "
Oct 31 08:28:51.460666 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.460638    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs" pod "f7dbd0db-5492-4bc5-ae41-bc27589836ce" (UID: "f7dbd0db-5492-4bc5-ae41-bc27589836ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:28:51.460758 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.460681    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr" pod "f7dbd0db-5492-4bc5-ae41-bc27589836ce" (UID: "f7dbd0db-5492-4bc5-ae41-bc27589836ce"). InnerVolumeSpecName "kube-api-access-926lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:28:51.559923 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.559884    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926lr\" (UniqueName: \"kubernetes.io/projected/f7dbd0db-5492-4bc5-ae41-bc27589836ce-kube-api-access-926lr\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:28:51.559923 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:51.559918    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7dbd0db-5492-4bc5-ae41-bc27589836ce-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:28:52.015323 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.015283    5872 generic.go:356] "Generic (PLEG): container finished" podID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerID="d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8" exitCode=0
Oct 31 08:28:52.015829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.015328    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"
Oct 31 08:28:52.015829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.015371    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" event={"ID":"f7dbd0db-5492-4bc5-ae41-bc27589836ce","Type":"ContainerDied","Data":"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"}
Oct 31 08:28:52.015829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.015432    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc" event={"ID":"f7dbd0db-5492-4bc5-ae41-bc27589836ce","Type":"ContainerDied","Data":"675bdc8750d752865ebbf7376b240bdba5cd8a3826832242ef7d59f92068f226"}
Oct 31 08:28:52.015829 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.015459    5872 scope.go:122] "RemoveContainer" containerID="d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"
Oct 31 08:28:52.024771 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.024754    5872 scope.go:122] "RemoveContainer" containerID="d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"
Oct 31 08:28:52.025033 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:28:52.025009    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8\": container with ID starting with d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8 not found: ID does not exist" containerID="d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"
Oct 31 08:28:52.025091 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.025040    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8"} err="failed to get container status \"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8\": rpc error: code = NotFound desc = could not find container \"d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8\": container with ID starting with d95535db9344372792c99b3b18707bcb0ab345084f35f951ececf959bcebd2d8 not found: ID does not exist"
Oct 31 08:28:52.178263 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.178230    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:28:52.228209 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.228176    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schemrzwc"]
Oct 31 08:28:52.508190 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:28:52.508159    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" path="/var/lib/kubelet/pods/f7dbd0db-5492-4bc5-ae41-bc27589836ce/volumes"
Oct 31 08:29:05.961376 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:05.961339    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 08:29:05.961776 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:05.961560    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy" containerID="cri-o://c01603d3cd6278e109349aed7a1a0ca453e63ae5ec9747ac205f81bd7e8e81bf" gracePeriod=30
Oct 31 08:29:06.011885 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:06.011851    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:29:06.012102 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:06.012081    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" containerID="cri-o://a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5" gracePeriod=30
Oct 31 08:29:06.013469 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:06.013445    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 08:29:06.013681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:06.013610    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy" containerID="cri-o://f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75" gracePeriod=30
Oct 31 08:29:10.527995 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:29:10.527932    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:29:10.916908 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:10.916872    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 08:29:10.917103 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:10.916938    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 08:29:11.120844 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.120816    5872 generic.go:356] "Generic (PLEG): container finished" podID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerID="c01603d3cd6278e109349aed7a1a0ca453e63ae5ec9747ac205f81bd7e8e81bf" exitCode=0
Oct 31 08:29:11.120990 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.120896    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerDied","Data":"c01603d3cd6278e109349aed7a1a0ca453e63ae5ec9747ac205f81bd7e8e81bf"}
Oct 31 08:29:11.121065 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.121001    5872 scope.go:122] "RemoveContainer" containerID="68760d836d42e10aabbd4d812bd9c1334959e8bc6e7d4de736cf70128beb2158"
Oct 31 08:29:11.269482 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.269459    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 08:29:11.308831 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.308806    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:29:11.311900 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.311879    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 08:29:11.349217 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349191    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349325 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349231    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.349325 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349270    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.349325 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349297    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349332    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.349465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349374    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349410    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.349465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349440    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349470    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349498    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349544    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349566    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349577    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349585    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349571    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.349645 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349622    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349658    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349695    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349720    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349755    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349790    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349792    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349814    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349856    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349885    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349931    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\") pod \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\" (UID: \"359fce47-4af6-4aa2-a6e0-688dfab34dbc\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349981    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349987    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.349961    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350008    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350023    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350043    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350081 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350097    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350127    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\") pod \"49d6e528-2a8e-485b-9805-0a8666d5172d\" (UID: \"49d6e528-2a8e-485b-9805-0a8666d5172d\") "
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350170    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\") pod \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\" (UID: \"d8af6a36-046f-4f33-98c6-63cd1edb53d3\") "
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350449    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350596    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350642    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350663    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350680    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350696    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350710    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350726    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350739    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350753    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350768    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d6e528-2a8e-485b-9805-0a8666d5172d-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.350987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.350777    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:29:11.351773 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.351489    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.351773 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.351741    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.352287 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.351919    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:29:11.352287 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.352062    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.352287 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.352256    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.352997 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.352953    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.353107 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353015    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.353107 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353046    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "kube-api-access-4bjl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.353107 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353045    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:29:11.353372 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353336    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "kube-api-access-4rscv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.353985 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353943    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "kube-api-access-qmvz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.354067 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.353943    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:29:11.354136 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.354074    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo" pod "49d6e528-2a8e-485b-9805-0a8666d5172d" (UID: "49d6e528-2a8e-485b-9805-0a8666d5172d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:29:11.354398 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.354380    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:29:11.354625 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.354605    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token" pod "d8af6a36-046f-4f33-98c6-63cd1edb53d3" (UID: "d8af6a36-046f-4f33-98c6-63cd1edb53d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.354762 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.354744    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token" pod "359fce47-4af6-4aa2-a6e0-688dfab34dbc" (UID: "359fce47-4af6-4aa2-a6e0-688dfab34dbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:29:11.452181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452112    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452139    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452161    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmvz7\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-kube-api-access-qmvz7\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452181 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452172    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452185    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d6e528-2a8e-485b-9805-0a8666d5172d-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452195    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452205    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bjl8\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-kube-api-access-4bjl8\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452216    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452228    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452240    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452252    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d6e528-2a8e-485b-9805-0a8666d5172d-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452266    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359fce47-4af6-4aa2-a6e0-688dfab34dbc-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452278    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452290    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8af6a36-046f-4f33-98c6-63cd1edb53d3-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452304    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452313    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452324    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rscv\" (UniqueName: \"kubernetes.io/projected/49d6e528-2a8e-485b-9805-0a8666d5172d-kube-api-access-4rscv\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:11.452463 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:11.452334    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8af6a36-046f-4f33-98c6-63cd1edb53d3-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:29:12.127262 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.127226    5872 generic.go:356] "Generic (PLEG): container finished" podID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerID="f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75" exitCode=0
Oct 31 08:29:12.127753 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.127280    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"
Oct 31 08:29:12.127753 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.127316    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" event={"ID":"49d6e528-2a8e-485b-9805-0a8666d5172d","Type":"ContainerDied","Data":"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"}
Oct 31 08:29:12.127753 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.127381    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5" event={"ID":"49d6e528-2a8e-485b-9805-0a8666d5172d","Type":"ContainerDied","Data":"601dee8a9bcb4bc6f0264f706335695927e9989c1d96c444999ab6370b0be98f"}
Oct 31 08:29:12.127753 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.127409    5872 scope.go:122] "RemoveContainer" containerID="f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"
Oct 31 08:29:12.129041 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.129013    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv" event={"ID":"359fce47-4af6-4aa2-a6e0-688dfab34dbc","Type":"ContainerDied","Data":"933440853be8f58d13b6f9b539516096aa6978f89f5170f7141c7e03c5b73752"}
Oct 31 08:29:12.129144 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.129116    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"
Oct 31 08:29:12.130490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.130467    5872 generic.go:356] "Generic (PLEG): container finished" podID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerID="a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5" exitCode=0
Oct 31 08:29:12.130591 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.130503    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"
Oct 31 08:29:12.130591 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.130555    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" event={"ID":"d8af6a36-046f-4f33-98c6-63cd1edb53d3","Type":"ContainerDied","Data":"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"}
Oct 31 08:29:12.130716 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.130596    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s" event={"ID":"d8af6a36-046f-4f33-98c6-63cd1edb53d3","Type":"ContainerDied","Data":"9a81d3efcbf9d4b7e2586f05d466b2866c49e7fd5c463fbd2fd1eb2959d1cd98"}
Oct 31 08:29:12.139141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.139121    5872 scope.go:122] "RemoveContainer" containerID="f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"
Oct 31 08:29:12.139445 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:29:12.139424    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75\": container with ID starting with f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75 not found: ID does not exist" containerID="f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"
Oct 31 08:29:12.139533 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.139457    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75"} err="failed to get container status \"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75\": rpc error: code = NotFound desc = could not find container \"f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75\": container with ID starting with f5c63668afd0518466b72ee1eb3e6102085ecefeb4238d43c1762635d4cf1a75 not found: ID does not exist"
Oct 31 08:29:12.139533 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.139481    5872 scope.go:122] "RemoveContainer" containerID="c01603d3cd6278e109349aed7a1a0ca453e63ae5ec9747ac205f81bd7e8e81bf"
Oct 31 08:29:12.148611 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.148595    5872 scope.go:122] "RemoveContainer" containerID="a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"
Oct 31 08:29:12.156468 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.156452    5872 scope.go:122] "RemoveContainer" containerID="a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"
Oct 31 08:29:12.156710 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:29:12.156694    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5\": container with ID starting with a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5 not found: ID does not exist" containerID="a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"
Oct 31 08:29:12.156759 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.156716    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5"} err="failed to get container status \"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5\": rpc error: code = NotFound desc = could not find container \"a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5\": container with ID starting with a1b9cca45df535aaf708f218c3d2dc4301212bb7787fddd44f9fa5d1d5aeaad5 not found: ID does not exist"
Oct 31 08:29:12.291417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.291338    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 08:29:12.341465 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.341435    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-hg2v5"]
Oct 31 08:29:12.454322 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.453441    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 08:29:12.459316 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.459277    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-s9pxv"]
Oct 31 08:29:12.508709 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.508675    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" path="/var/lib/kubelet/pods/359fce47-4af6-4aa2-a6e0-688dfab34dbc/volumes"
Oct 31 08:29:12.509134 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.509121    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" path="/var/lib/kubelet/pods/49d6e528-2a8e-485b-9805-0a8666d5172d/volumes"
Oct 31 08:29:12.567292 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.567214    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:29:12.577338 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:12.577306    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-ns26s"]
Oct 31 08:29:14.508233 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:14.508197    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" path="/var/lib/kubelet/pods/d8af6a36-046f-4f33-98c6-63cd1edb53d3/volumes"
Oct 31 08:29:15.365436 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365402    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:29:15.365769 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365756    5872 cpu_manager.go:414] "containerMap: removing container" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365769    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365782    5872 cpu_manager.go:414] "containerMap: removing container" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365787    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365794    5872 cpu_manager.go:414] "containerMap: removing container" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365799    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365807    5872 cpu_manager.go:414] "containerMap: removing container" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:29:15.365814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365812    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365824    5872 cpu_manager.go:414] "containerMap: removing container" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365829    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365840    5872 cpu_manager.go:414] "containerMap: removing container" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365845    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365908    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365915    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf834f2e-85eb-4d88-a0df-fa2ba7b543dc" containerName="main"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365927    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7dbd0db-5492-4bc5-ae41-bc27589836ce" containerName="main"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365933    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8af6a36-046f-4f33-98c6-63cd1edb53d3" containerName="istio-proxy"
Oct 31 08:29:15.366039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.365938    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="49d6e528-2a8e-485b-9805-0a8666d5172d" containerName="istio-proxy"
Oct 31 08:29:15.370483 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.370467    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.473933 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.473898    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"openshift-service-ca.crt\""
Oct 31 08:29:15.473933 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.473920    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"kube-root-ca.crt\""
Oct 31 08:29:15.474155 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.473932    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-765xq\""
Oct 31 08:29:15.474155 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.473941    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"default-dockercfg-zpxzg\""
Oct 31 08:29:15.474155 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.474037    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Oct 31 08:29:15.475720 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.475700    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:29:15.489833 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.489805    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h2n4\" (UniqueName: \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.490001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.489863    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.590542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.590506    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h2n4\" (UniqueName: \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.590918 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.590557    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.593087 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.593060    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.649205 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.649148    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h2n4\" (UniqueName: \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:15.683194 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:15.683160    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:16.058879 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:16.058703    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:29:16.061638 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:29:16.061611    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437c4be9_b59c_49a4_97b1_a0f18000a858.slice/crio-a990e9b1bec35442de97c2a9588667e4cdbf82826440cf3f627e58d19b974f09 WatchSource:0}: Error finding container a990e9b1bec35442de97c2a9588667e4cdbf82826440cf3f627e58d19b974f09: Status 404 returned error can't find the container with id a990e9b1bec35442de97c2a9588667e4cdbf82826440cf3f627e58d19b974f09
Oct 31 08:29:16.155775 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:16.155743    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" event={"ID":"437c4be9-b59c-49a4-97b1-a0f18000a858","Type":"ContainerStarted","Data":"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"}
Oct 31 08:29:16.155948 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:16.155801    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" event={"ID":"437c4be9-b59c-49a4-97b1-a0f18000a858","Type":"ContainerStarted","Data":"a990e9b1bec35442de97c2a9588667e4cdbf82826440cf3f627e58d19b974f09"}
Oct 31 08:29:16.155948 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:16.155835    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:16.269514 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:16.269452    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podStartSLOduration=1.269438331 podStartE2EDuration="1.269438331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:29:16.267886418 +0000 UTC m=+3565.880096163" watchObservedRunningTime="2026-10-31 08:29:16.269438331 +0000 UTC m=+3565.881648080"
Oct 31 08:29:40.527788 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:29:40.527747    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:29:47.162023 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:47.161991    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:29:50.961781 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:50.961754    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:29:50.978797 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:50.978770    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:29:50.980161 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:50.980137    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:29:50.995165 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:29:50.995145    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:30:10.527355 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:30:10.527317    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:30:40.526746 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:30:40.526699    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:31:10.527728 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:31:10.527694    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:31:29.132552 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:29.132470    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:31:37.162817 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:37.162780    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:31:40.527925 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:31:40.527886    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:31:44.152555 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:44.152503    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main" containerID="cri-o://178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21" gracePeriod=45
Oct 31 08:31:47.162837 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:47.162794    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:31:57.162786 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:57.162744    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:31:57.163195 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:31:57.162856    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:32:07.162087 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:07.162042    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:32:10.527429 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:32:10.527396    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:32:14.388572 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.388544    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:32:14.442171 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.442118    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\" (UniqueName: \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\") pod \"437c4be9-b59c-49a4-97b1-a0f18000a858\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") "
Oct 31 08:32:14.442277 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.442188    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\" (UniqueName: \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\") pod \"437c4be9-b59c-49a4-97b1-a0f18000a858\" (UID: \"437c4be9-b59c-49a4-97b1-a0f18000a858\") "
Oct 31 08:32:14.444332 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.444307    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs" pod "437c4be9-b59c-49a4-97b1-a0f18000a858" (UID: "437c4be9-b59c-49a4-97b1-a0f18000a858"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:32:14.444436 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.444386    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4" pod "437c4be9-b59c-49a4-97b1-a0f18000a858" (UID: "437c4be9-b59c-49a4-97b1-a0f18000a858"). InnerVolumeSpecName "kube-api-access-5h2n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:32:14.543790 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.543760    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/437c4be9-b59c-49a4-97b1-a0f18000a858-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:32:14.543790 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:14.543792    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h2n4\" (UniqueName: \"kubernetes.io/projected/437c4be9-b59c-49a4-97b1-a0f18000a858-kube-api-access-5h2n4\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:32:15.057425 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.057387    5872 generic.go:356] "Generic (PLEG): container finished" podID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerID="178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21" exitCode=0
Oct 31 08:32:15.057597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.057436    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"
Oct 31 08:32:15.057597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.057472    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" event={"ID":"437c4be9-b59c-49a4-97b1-a0f18000a858","Type":"ContainerDied","Data":"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"}
Oct 31 08:32:15.057597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.057531    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7" event={"ID":"437c4be9-b59c-49a4-97b1-a0f18000a858","Type":"ContainerDied","Data":"a990e9b1bec35442de97c2a9588667e4cdbf82826440cf3f627e58d19b974f09"}
Oct 31 08:32:15.057597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.057560    5872 scope.go:122] "RemoveContainer" containerID="178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"
Oct 31 08:32:15.066395 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.066374    5872 scope.go:122] "RemoveContainer" containerID="178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"
Oct 31 08:32:15.066693 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:32:15.066669    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21\": container with ID starting with 178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21 not found: ID does not exist" containerID="178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"
Oct 31 08:32:15.066744 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.066706    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21"} err="failed to get container status \"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21\": rpc error: code = NotFound desc = could not find container \"178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21\": container with ID starting with 178e0ab97175c0ba812de0a9688b15cf0ea398b282293f8cb209a2fb3c199b21 not found: ID does not exist"
Oct 31 08:32:15.221157 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.221124    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:32:15.270856 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:15.270825    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95vndd7"]
Oct 31 08:32:16.508345 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:16.508311    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" path="/var/lib/kubelet/pods/437c4be9-b59c-49a4-97b1-a0f18000a858/volumes"
Oct 31 08:32:19.131626 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.131590    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:32:19.132080 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.132043    5872 cpu_manager.go:414] "containerMap: removing container" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main"
Oct 31 08:32:19.132080 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.132057    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main"
Oct 31 08:32:19.132164 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.132121    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="437c4be9-b59c-49a4-97b1-a0f18000a858" containerName="main"
Oct 31 08:32:19.132164 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.132133    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="359fce47-4af6-4aa2-a6e0-688dfab34dbc" containerName="istio-proxy"
Oct 31 08:32:19.136584 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.136563    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.183947 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.183911    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.183947 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.183949    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184151 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184027    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184151 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184130    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184229 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184150    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184264 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184229    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184264 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184255    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184340 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184270    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.184382 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.184354    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt766\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.212934 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.212910    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-service-ca.crt\""
Oct 31 08:32:19.220841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.220817    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-gw-ca-root-cert\""
Oct 31 08:32:19.220841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.220834    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"kube-root-ca.crt\""
Oct 31 08:32:19.220997 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.220834    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-gateway-2-openshift-default-dockercfg-rr6m6\""
Oct 31 08:32:19.240798 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.240774    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:32:19.285034 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285000    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285173 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285038    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285173 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285088    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285173 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285125    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285173 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285150    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285206    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt766\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285256    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285283    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285390 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285338    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285605 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285500    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285857 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285833    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285991 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285894    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.285991 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.285934    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.286318 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.286292    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.287539 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.287515    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.288037 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.288020    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.347411 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.347382    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.347540 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.347472    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt766\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\") pod \"router-gateway-2-openshift-default-5c7b9689b9-4jwtq\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.449744 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.449714    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:19.876129 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.876103    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:32:19.878844 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:32:19.878817    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56327c6_b3cc_4427_8dbc_2bae18a16e3a.slice/crio-b5aacca0911cdb827768e0f47d658ba09085d79dbac5e16cf5962f5f7ec56b77 WatchSource:0}: Error finding container b5aacca0911cdb827768e0f47d658ba09085d79dbac5e16cf5962f5f7ec56b77: Status 404 returned error can't find the container with id b5aacca0911cdb827768e0f47d658ba09085d79dbac5e16cf5962f5f7ec56b77
Oct 31 08:32:19.880898 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.880866    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:19.880958 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.880927    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:19.881017 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:19.880958    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:20.087140 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:20.087104    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerStarted","Data":"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"}
Oct 31 08:32:20.087312 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:20.087162    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerStarted","Data":"b5aacca0911cdb827768e0f47d658ba09085d79dbac5e16cf5962f5f7ec56b77"}
Oct 31 08:32:20.225714 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:20.225664    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podStartSLOduration=1.225650704 podStartE2EDuration="1.225650704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:32:20.223605033 +0000 UTC m=+3749.835814796" watchObservedRunningTime="2026-10-31 08:32:20.225650704 +0000 UTC m=+3749.837860443"
Oct 31 08:32:20.450014 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:20.449958    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:20.454911 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:20.454886    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:21.092118 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:21.092086    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:21.093158 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:21.093137    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:33.152884 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.152800    5872 generic.go:356] "Generic (PLEG): container finished" podID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerID="31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168" exitCode=0
Oct 31 08:32:33.152884 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.152849    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerDied","Data":"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"}
Oct 31 08:32:33.153355 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.153175    5872 scope.go:122] "RemoveContainer" containerID="31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"
Oct 31 08:32:33.154251 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.154221    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:33.154313 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.154293    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:33.154346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:33.154327    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:32:34.176843 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.176806    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerStarted","Data":"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"}
Oct 31 08:32:34.457048 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.452288    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:34.457048 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.456252    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 31 08:32:34.472032 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.469778    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:32:34.474252 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.474220    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.481292 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.481255    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9knr\" (UniqueName: \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.481404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.481352    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.525132 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.525095    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:32:34.526392 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.526364    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Oct 31 08:32:34.526575 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.526364    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-epp-sa-dockercfg-8fbfz\""
Oct 31 08:32:34.526575 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.526386    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"default-dockercfg-5zqt7\""
Oct 31 08:32:34.582816 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.582775    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9knr\" (UniqueName: \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.583023 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.582850    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.585560 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.585525    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.639559 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.639522    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9knr\" (UniqueName: \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:34.787915 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:34.787826    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:35.168049 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:35.163096    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:32:35.175989 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:32:35.175942    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90af62d8_8c04_4d1f_961e_1bb085a379e0.slice/crio-a12516405b798f091c61ec33c7df5d761ea946cfe52432c10d16c8d4fb8f429b WatchSource:0}: Error finding container a12516405b798f091c61ec33c7df5d761ea946cfe52432c10d16c8d4fb8f429b: Status 404 returned error can't find the container with id a12516405b798f091c61ec33c7df5d761ea946cfe52432c10d16c8d4fb8f429b
Oct 31 08:32:35.184776 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:35.184744    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" event={"ID":"90af62d8-8c04-4d1f-961e-1bb085a379e0","Type":"ContainerStarted","Data":"a12516405b798f091c61ec33c7df5d761ea946cfe52432c10d16c8d4fb8f429b"}
Oct 31 08:32:35.468046 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:35.465351    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 31 08:32:36.092564 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:36.092522    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:36.191368 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:36.191329    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" event={"ID":"90af62d8-8c04-4d1f-961e-1bb085a379e0","Type":"ContainerStarted","Data":"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"}
Oct 31 08:32:36.191776 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:36.191409    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:32:36.306133 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:36.306084    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podStartSLOduration=2.306071312 podStartE2EDuration="2.306071312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:32:36.304542456 +0000 UTC m=+3765.916752200" watchObservedRunningTime="2026-10-31 08:32:36.306071312 +0000 UTC m=+3765.918281054"
Oct 31 08:32:36.455772 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:36.455362    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 31 08:32:37.467476 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:37.467431    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 31 08:32:38.458991 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:38.451324    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 31 08:32:39.454065 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:39.454031    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:39.455134 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:32:39.455111    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:32:40.527297 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:32:40.527267    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:33:07.198490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:33:07.198412    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:33:10.528352 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:33:10.528318    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:33:40.528106 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:33:40.528070    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:34:10.527336 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:34:10.527297    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:34:40.527928 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:34:40.527847    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:34:48.065050 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:48.065016    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:34:51.000596 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:51.000572    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:34:51.017931 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:51.017902    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:34:51.021493 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:51.021468    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:34:51.035050 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:51.035032    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:34:57.198124 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:34:57.198077    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:35:03.084821 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:03.084763    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main" containerID="cri-o://8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b" gracePeriod=45
Oct 31 08:35:07.198669 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:07.198632    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:35:10.528138 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:35:10.528101    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:35:17.198706 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:17.198669    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:35:17.199115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:17.198784    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:35:27.199014 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:27.198952    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:35:33.329988 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.329950    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:35:33.441214 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.441179    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\" (UniqueName: \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\") pod \"90af62d8-8c04-4d1f-961e-1bb085a379e0\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") "
Oct 31 08:35:33.441398 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.441233    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\" (UniqueName: \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\") pod \"90af62d8-8c04-4d1f-961e-1bb085a379e0\" (UID: \"90af62d8-8c04-4d1f-961e-1bb085a379e0\") "
Oct 31 08:35:33.443342 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.443314    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr" pod "90af62d8-8c04-4d1f-961e-1bb085a379e0" (UID: "90af62d8-8c04-4d1f-961e-1bb085a379e0"). InnerVolumeSpecName "kube-api-access-z9knr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:35:33.443448 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.443389    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs" pod "90af62d8-8c04-4d1f-961e-1bb085a379e0" (UID: "90af62d8-8c04-4d1f-961e-1bb085a379e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:35:33.542813 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.542777    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90af62d8-8c04-4d1f-961e-1bb085a379e0-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:33.542813 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:33.542805    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9knr\" (UniqueName: \"kubernetes.io/projected/90af62d8-8c04-4d1f-961e-1bb085a379e0-kube-api-access-z9knr\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:34.077841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.077797    5872 generic.go:356] "Generic (PLEG): container finished" podID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerID="8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b" exitCode=0
Oct 31 08:35:34.077841 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.077846    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"
Oct 31 08:35:34.078071 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.077876    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" event={"ID":"90af62d8-8c04-4d1f-961e-1bb085a379e0","Type":"ContainerDied","Data":"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"}
Oct 31 08:35:34.078071 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.077933    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s" event={"ID":"90af62d8-8c04-4d1f-961e-1bb085a379e0","Type":"ContainerDied","Data":"a12516405b798f091c61ec33c7df5d761ea946cfe52432c10d16c8d4fb8f429b"}
Oct 31 08:35:34.078071 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.077956    5872 scope.go:122] "RemoveContainer" containerID="8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"
Oct 31 08:35:34.087115 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.087096    5872 scope.go:122] "RemoveContainer" containerID="8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"
Oct 31 08:35:34.087368 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:35:34.087348    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b\": container with ID starting with 8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b not found: ID does not exist" containerID="8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"
Oct 31 08:35:34.087412 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.087376    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b"} err="failed to get container status \"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b\": rpc error: code = NotFound desc = could not find container \"8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b\": container with ID starting with 8578140bf5e440ff0efdad158b6b6d99a6b20975828b719373f595edb939745b not found: ID does not exist"
Oct 31 08:35:34.241521 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.241486    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:35:34.291899 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.291871    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dljq4s"]
Oct 31 08:35:34.508405 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:34.508374    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" path="/var/lib/kubelet/pods/90af62d8-8c04-4d1f-961e-1bb085a379e0/volumes"
Oct 31 08:35:40.529402 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:35:40.529368    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:35:42.527061 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:42.527029    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:35:42.527487 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:42.527212    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy" containerID="cri-o://93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0" gracePeriod=30
Oct 31 08:35:47.783995 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.783948    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:35:47.877392 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877320    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877392 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877360    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877580 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877411    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877580 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877439    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877580 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877480    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877580 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877525    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877580 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877558    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877837 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877596    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877837 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877627    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\") pod \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\" (UID: \"f56327c6-b3cc-4427-8dbc-2bae18a16e3a\") "
Oct 31 08:35:47.877837 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877690    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:35:47.878029 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877886    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:35:47.878029 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.877925    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:35:47.878029 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.878013    5872 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.878198 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.878036    5872 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-credential-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.878198 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.878144    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:35:47.878311 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.878285    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:35:47.879680 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.879651    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:35:47.879801 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.879708    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "kube-api-access-jt766". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:35:47.879801 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.879725    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:35:47.879801 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.879792    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo" pod "f56327c6-b3cc-4427-8dbc-2bae18a16e3a" (UID: "f56327c6-b3cc-4427-8dbc-2bae18a16e3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:35:47.979212 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979180    5872 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-envoy\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979212 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979207    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt766\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-kube-api-access-jt766\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979212 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979218    5872 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-podinfo\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979422 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979227    5872 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-data\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979422 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979236    5872 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-workload-socket\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979422 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979245    5872 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istio-token\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:47.979422 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:47.979253    5872 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f56327c6-b3cc-4427-8dbc-2bae18a16e3a-istiod-ca-cert\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:35:48.151124 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.151049    5872 generic.go:356] "Generic (PLEG): container finished" podID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerID="93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0" exitCode=0
Oct 31 08:35:48.151124 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.151102    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"
Oct 31 08:35:48.151346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.151132    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerDied","Data":"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"}
Oct 31 08:35:48.151346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.151187    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq" event={"ID":"f56327c6-b3cc-4427-8dbc-2bae18a16e3a","Type":"ContainerDied","Data":"b5aacca0911cdb827768e0f47d658ba09085d79dbac5e16cf5962f5f7ec56b77"}
Oct 31 08:35:48.151346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.151210    5872 scope.go:122] "RemoveContainer" containerID="93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"
Oct 31 08:35:48.161747 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.161729    5872 scope.go:122] "RemoveContainer" containerID="31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"
Oct 31 08:35:48.171420 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.171403    5872 scope.go:122] "RemoveContainer" containerID="93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"
Oct 31 08:35:48.171681 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:35:48.171664    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0\": container with ID starting with 93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0 not found: ID does not exist" containerID="93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"
Oct 31 08:35:48.171751 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.171689    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0"} err="failed to get container status \"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0\": rpc error: code = NotFound desc = could not find container \"93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0\": container with ID starting with 93039cdf48b37cd4f64b55cd6c182e8cb414c0c50b382ffa3b2859095a3229e0 not found: ID does not exist"
Oct 31 08:35:48.171751 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.171706    5872 scope.go:122] "RemoveContainer" containerID="31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"
Oct 31 08:35:48.172002 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:35:48.171983    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168\": container with ID starting with 31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168 not found: ID does not exist" containerID="31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"
Oct 31 08:35:48.172059 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.172006    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168"} err="failed to get container status \"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168\": rpc error: code = NotFound desc = could not find container \"31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168\": container with ID starting with 31023c7df00115d1871d8cb4fd734601f1b2189361e42fdd49e417bca8b22168 not found: ID does not exist"
Oct 31 08:35:48.326749 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.326712    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:35:48.331222 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.331197    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-5c7b9689b9-4jwtq"]
Oct 31 08:35:48.508001 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:35:48.507952    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" path="/var/lib/kubelet/pods/f56327c6-b3cc-4427-8dbc-2bae18a16e3a/volumes"
Oct 31 08:36:10.527048 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:36:10.527013    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:36:40.528114 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:36:40.528079    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:37:10.529765 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:37:10.529725    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:37:40.527095 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:37:40.527059    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:38:10.461962 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.461927    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462299    5872 cpu_manager.go:414] "containerMap: removing container" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462311    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462328    5872 cpu_manager.go:414] "containerMap: removing container" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462333    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462349    5872 cpu_manager.go:414] "containerMap: removing container" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462356    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462410    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="90af62d8-8c04-4d1f-961e-1bb085a379e0" containerName="main"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462422    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.462451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.462429    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="f56327c6-b3cc-4427-8dbc-2bae18a16e3a" containerName="istio-proxy"
Oct 31 08:38:10.465385 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.465370    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.524277 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.524243    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:38:10.531847 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:38:10.531808    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:38:10.559272 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.559232    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.559433 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.559291    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjcs\" (UniqueName: \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.570659 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.570632    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"kube-root-ca.crt\""
Oct 31 08:38:10.570802 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.570690    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"openshift-service-ca.crt\""
Oct 31 08:38:10.570870 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.570856    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa-dockercfg-4lc6q\""
Oct 31 08:38:10.570870 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.570864    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"default-dockercfg-khhlv\""
Oct 31 08:38:10.570991 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.570862    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Oct 31 08:38:10.660132 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.660100    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjcs\" (UniqueName: \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.660324 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.660197    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.662754 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.662728    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.717335 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.717271    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjcs\" (UniqueName: \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:10.780265 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:10.780235    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:11.153156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:11.153131    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:38:11.155528 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:38:11.155501    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f81971d_be28_4506_a600_a2e0fb0e2ea5.slice/crio-3965e6057b8cbe4b9b3b7615d2302dbab213286b3ec2c3391ca70cd7840d9446 WatchSource:0}: Error finding container 3965e6057b8cbe4b9b3b7615d2302dbab213286b3ec2c3391ca70cd7840d9446: Status 404 returned error can't find the container with id 3965e6057b8cbe4b9b3b7615d2302dbab213286b3ec2c3391ca70cd7840d9446
Oct 31 08:38:11.857157 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:11.857125    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" event={"ID":"7f81971d-be28-4506-a600-a2e0fb0e2ea5","Type":"ContainerStarted","Data":"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"}
Oct 31 08:38:11.857597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:11.857176    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" event={"ID":"7f81971d-be28-4506-a600-a2e0fb0e2ea5","Type":"ContainerStarted","Data":"3965e6057b8cbe4b9b3b7615d2302dbab213286b3ec2c3391ca70cd7840d9446"}
Oct 31 08:38:11.857597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:11.857330    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:38:11.971097 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:11.971040    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podStartSLOduration=1.97102639 podStartE2EDuration="1.97102639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:38:11.970245005 +0000 UTC m=+4101.582454744" watchObservedRunningTime="2026-10-31 08:38:11.97102639 +0000 UTC m=+4101.583236132"
Oct 31 08:38:40.527261 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:38:40.527223    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:38:42.863535 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:38:42.863507    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:39:10.528898 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:39:10.528818    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:39:20.348451 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.348415    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:39:20.351926 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.351909    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.406216 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.406187    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:39:20.454092 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.454057    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"default-dockercfg-th4wv\""
Oct 31 08:39:20.454266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.454119    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"kube-root-ca.crt\""
Oct 31 08:39:20.454266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.454136    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"lora-pvc-adapters-test-kserve-self-signed-certs\""
Oct 31 08:39:20.454266 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.454194    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"openshift-service-ca.crt\""
Oct 31 08:39:20.462661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.462633    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.462738 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.462675    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.462738 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.462702    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.462827 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.462814    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.462864 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.462850    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.563861 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.563830    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.563869    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.563891    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.563921    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.563947    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnj8w\" (UniqueName: \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564033 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.564021    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.564323    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564358 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.564339    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.564484 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.564419    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.566241 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.566219    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.566557 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.566538    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.664928 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.664902    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnj8w\" (UniqueName: \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:20.721379 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:20.721346    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnj8w\" (UniqueName: \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.229314 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.229280    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.333258 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.333226    5872 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") device path: \"\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.430936 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.430896    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.431160 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.431137    5872 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") DevicePath \"\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.483135 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.483061    5872 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") DevicePath \"csi-ec7c1ef4f5c9abea798a2be2ac98784d07a27b57a5fef45f988a9142e02c24b1\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.629100 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.629062    5872 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/610c7b521ea5c930d2863ede1e3d8aa55e0e337945c3b806d42d0c59e251b146/globalmount\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.698139 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.698111    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:28.764838 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:28.764770    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:29.240028 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:29.239992    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:39:29.293410 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:39:29.293382    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbced594c_f983_4ae8_b7a9_ce41a5a3c563.slice/crio-52e0a6d9f678f7b29dd6d5157d74919611b726b494990e02e2b87aea9889a008 WatchSource:0}: Error finding container 52e0a6d9f678f7b29dd6d5157d74919611b726b494990e02e2b87aea9889a008: Status 404 returned error can't find the container with id 52e0a6d9f678f7b29dd6d5157d74919611b726b494990e02e2b87aea9889a008
Oct 31 08:39:29.295368 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:29.295349    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 08:39:30.255039 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:30.255001    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" event={"ID":"bced594c-f983-4ae8-b7a9-ce41a5a3c563","Type":"ContainerStarted","Data":"52e0a6d9f678f7b29dd6d5157d74919611b726b494990e02e2b87aea9889a008"}
Oct 31 08:39:40.535445 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:39:40.535400    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:39:51.042148 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:51.042110    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:39:51.058096 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:51.058069    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:39:51.063225 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:51.063202    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:39:51.079479 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:51.079458    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:39:58.437078 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:58.436985    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" event={"ID":"bced594c-f983-4ae8-b7a9-ce41a5a3c563","Type":"ContainerStarted","Data":"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"}
Oct 31 08:39:58.652799 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:58.652729    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podStartSLOduration=9.772829983 podStartE2EDuration="38.652712193s" totalImagesPullingTime="28.87988221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 08:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:39:58.60229196 +0000 UTC m=+4208.214501702" watchObservedRunningTime="2026-10-31 08:39:58.652712193 +0000 UTC m=+4208.264921938"
Oct 31 08:39:58.765712 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:58.765632    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:58.765712 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:58.765690    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:39:58.767309 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:39:58.767279    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:00.944022 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:00.943989    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:40:02.864275 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:02.864234    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:40:08.765715 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:08.765668    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:10.527289 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:40:10.527249    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:40:12.864142 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:12.864100    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:40:15.967918 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:15.967867    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" containerID="cri-o://783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796" gracePeriod=45
Oct 31 08:40:18.765506 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:18.765458    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:22.864411 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:22.864372    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:40:22.864794 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:22.864470    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:40:28.765719 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:28.765620    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:32.864314 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:32.864274    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:40:38.765476 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:38.765424    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:40.527776 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:40:40.527732    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:40:42.863999 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:42.863949    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:40:46.221020 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.220993    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:40:46.281729 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.281697    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\" (UniqueName: \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\") pod \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") "
Oct 31 08:40:46.281894 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.281758    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\") pod \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\" (UID: \"7f81971d-be28-4506-a600-a2e0fb0e2ea5\") "
Oct 31 08:40:46.283986 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.283928    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs" pod "7f81971d-be28-4506-a600-a2e0fb0e2ea5" (UID: "7f81971d-be28-4506-a600-a2e0fb0e2ea5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:40:46.284095 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.284001    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs" pod "7f81971d-be28-4506-a600-a2e0fb0e2ea5" (UID: "7f81971d-be28-4506-a600-a2e0fb0e2ea5"). InnerVolumeSpecName "kube-api-access-pxjcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:40:46.383313 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.383229    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f81971d-be28-4506-a600-a2e0fb0e2ea5-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:40:46.383313 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.383262    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjcs\" (UniqueName: \"kubernetes.io/projected/7f81971d-be28-4506-a600-a2e0fb0e2ea5-kube-api-access-pxjcs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:40:46.687784 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.687748    5872 generic.go:356] "Generic (PLEG): container finished" podID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerID="783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796" exitCode=0
Oct 31 08:40:46.687983 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.687811    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"
Oct 31 08:40:46.687983 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.687832    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" event={"ID":"7f81971d-be28-4506-a600-a2e0fb0e2ea5","Type":"ContainerDied","Data":"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"}
Oct 31 08:40:46.687983 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.687894    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7" event={"ID":"7f81971d-be28-4506-a600-a2e0fb0e2ea5","Type":"ContainerDied","Data":"3965e6057b8cbe4b9b3b7615d2302dbab213286b3ec2c3391ca70cd7840d9446"}
Oct 31 08:40:46.687983 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.687923    5872 scope.go:122] "RemoveContainer" containerID="783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"
Oct 31 08:40:46.699305 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.699276    5872 scope.go:122] "RemoveContainer" containerID="783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"
Oct 31 08:40:46.699676 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:40:46.699633    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796\": container with ID starting with 783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796 not found: ID does not exist" containerID="783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"
Oct 31 08:40:46.699769 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.699686    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796"} err="failed to get container status \"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796\": rpc error: code = NotFound desc = could not find container \"783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796\": container with ID starting with 783ebe5ac81da8c31261bfd6cc8473fb9799fae0a946c426a8a643c115636796 not found: ID does not exist"
Oct 31 08:40:46.851685 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.851647    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:40:46.901743 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:46.901711    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schezctt7"]
Oct 31 08:40:48.508322 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:48.508281    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" path="/var/lib/kubelet/pods/7f81971d-be28-4506-a600-a2e0fb0e2ea5/volumes"
Oct 31 08:40:48.765483 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:48.765397    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:40:58.765824 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:40:58.765781    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:41:08.765980 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:41:08.765915    5872 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" probeResult="failure" output="Get \"https://10.134.0.79:8000/health\": dial tcp 10.134.0.79:8000: connect: connection refused"
Oct 31 08:41:10.528467 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:41:10.528427    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:41:18.775672 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:41:18.775628    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:41:18.783138 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:41:18.783115    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:41:40.528830 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:41:40.528794    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:42:10.529629 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:42:10.529542    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:42:40.527240 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:42:40.527133    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:43:10.528432 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:43:10.528395    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:43:40.527149 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:43:40.527069    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:43:52.552219 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:43:52.552184    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-with-lora-adapters-a290d4b0_lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl_bced594c-f983-4ae8-b7a9-ce41a5a3c563/main/0.log"
Oct 31 08:43:56.887467 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:43:56.887433    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:44:10.527101 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:44:10.527064    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:44:11.910394 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:11.910336    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main" containerID="cri-o://3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300" gracePeriod=45
Oct 31 08:44:12.575299 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.575273    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:44:12.597471 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597406    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\" (UniqueName: \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597619 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597466    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\" (UniqueName: \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597619 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597519    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597746 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597617    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597746 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597671    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597746 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597701    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.597746 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.597737    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\") pod \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\" (UID: \"bced594c-f983-4ae8-b7a9-ce41a5a3c563\") "
Oct 31 08:44:12.598222 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.598145    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:44:12.598222 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.598191    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:44:12.600146 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.600091    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:44:12.600271 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.600192    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:44:12.600271 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.600208    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "kube-api-access-bnj8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:44:12.606288 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.606262    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 31 08:44:12.608632 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.608609    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir" pod "bced594c-f983-4ae8-b7a9-ce41a5a3c563" (UID: "bced594c-f983-4ae8-b7a9-ce41a5a3c563"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:44:12.699318 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699288    5872 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-dshm\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699332    5872 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" "
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699343    5872 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tmp-dir\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699353    5872 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-home\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699361    5872 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bced594c-f983-4ae8-b7a9-ce41a5a3c563-model-cache\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699371    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnj8w\" (UniqueName: \"kubernetes.io/projected/bced594c-f983-4ae8-b7a9-ce41a5a3c563-kube-api-access-bnj8w\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.699443 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.699380    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bced594c-f983-4ae8-b7a9-ce41a5a3c563-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:44:12.727681 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.727664    5872 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e") on node "ip-10-0-140-145.us-west-1.compute.internal"
Oct 31 08:44:12.742416 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.742392    5872 generic.go:356] "Generic (PLEG): container finished" podID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerID="3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300" exitCode=0
Oct 31 08:44:12.742501 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.742433    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"
Oct 31 08:44:12.742549 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.742426    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" event={"ID":"bced594c-f983-4ae8-b7a9-ce41a5a3c563","Type":"ContainerDied","Data":"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"}
Oct 31 08:44:12.742584 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.742551    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl" event={"ID":"bced594c-f983-4ae8-b7a9-ce41a5a3c563","Type":"ContainerDied","Data":"52e0a6d9f678f7b29dd6d5157d74919611b726b494990e02e2b87aea9889a008"}
Oct 31 08:44:12.742584 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.742578    5872 scope.go:122] "RemoveContainer" containerID="3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"
Oct 31 08:44:12.752636 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.752619    5872 scope.go:122] "RemoveContainer" containerID="3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"
Oct 31 08:44:12.752868 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:44:12.752847    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300\": container with ID starting with 3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300 not found: ID does not exist" containerID="3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"
Oct 31 08:44:12.752916 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.752874    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300"} err="failed to get container status \"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300\": rpc error: code = NotFound desc = could not find container \"3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300\": container with ID starting with 3e2ebe5a7ca101b8fbc740acb701e8d170d3cc443a54effa96f4100b8cbd8300 not found: ID does not exist"
Oct 31 08:44:12.800471 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.800448    5872 reconciler_common.go:299] "Volume detached for volume \"pvc-43dec6d8-5073-49ff-9a60-668d1ef5314e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ae6d4bc3a7e09e\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"csi-ec7c1ef4f5c9abea798a2be2ac98784d07a27b57a5fef45f988a9142e02c24b1\""
Oct 31 08:44:12.908002 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.907914    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:44:12.911499 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:12.911473    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-z7gwl"]
Oct 31 08:44:14.508362 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:14.508328    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" path="/var/lib/kubelet/pods/bced594c-f983-4ae8-b7a9-ce41a5a3c563/volumes"
Oct 31 08:44:25.801979 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.801943    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:44:25.802483 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802464    5872 cpu_manager.go:414] "containerMap: removing container" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main"
Oct 31 08:44:25.802542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802489    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main"
Oct 31 08:44:25.802542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802515    5872 cpu_manager.go:414] "containerMap: removing container" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main"
Oct 31 08:44:25.802542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802523    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main"
Oct 31 08:44:25.802653 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802641    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="bced594c-f983-4ae8-b7a9-ce41a5a3c563" containerName="main"
Oct 31 08:44:25.802687 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.802664    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f81971d-be28-4506-a600-a2e0fb0e2ea5" containerName="main"
Oct 31 08:44:25.807351 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.807332    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.861759 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.861714    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"openshift-service-ca.crt\""
Oct 31 08:44:25.911547 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.911517    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"kube-root-ca.crt\""
Oct 31 08:44:25.911723 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.911572    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"default-dockercfg-d865w\""
Oct 31 08:44:25.911723 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.911571    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"model-routing-only-7aad4d71-kserve-self-signed-certs\""
Oct 31 08:44:25.913399 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.913376    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:44:25.919019 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919000    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.919084 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919033    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmdnh\" (UniqueName: \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.919084 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919053    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.919194 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919138    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.919249 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919209    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:25.919319 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:25.919305    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020468 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020431    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020476    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020524    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020552    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020582    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmdnh\" (UniqueName: \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020644 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020608    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.020944 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.020923    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.021031 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.021000    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.021114 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.021044    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.023012 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.022990    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.023419 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.023398    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.078725 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.078667    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmdnh\" (UniqueName: \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-42hfp\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.119586 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.119560    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:26.493577 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.493544    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:44:26.495436 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:44:26.495413    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444fdf01_f21e_4be9_a2ee_1b180373851b.slice/crio-e63a1e36fbc40316474af15d49da835a7889df4f4da86b27ebf65dbbe3603fd6 WatchSource:0}: Error finding container e63a1e36fbc40316474af15d49da835a7889df4f4da86b27ebf65dbbe3603fd6: Status 404 returned error can't find the container with id e63a1e36fbc40316474af15d49da835a7889df4f4da86b27ebf65dbbe3603fd6
Oct 31 08:44:26.812035 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.811937    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" event={"ID":"444fdf01-f21e-4be9-a2ee-1b180373851b","Type":"ContainerStarted","Data":"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"}
Oct 31 08:44:26.812035 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.812016    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" event={"ID":"444fdf01-f21e-4be9-a2ee-1b180373851b","Type":"ContainerStarted","Data":"e63a1e36fbc40316474af15d49da835a7889df4f4da86b27ebf65dbbe3603fd6"}
Oct 31 08:44:26.927624 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:26.927564    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" podStartSLOduration=1.927549012 podStartE2EDuration="1.927549012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:44:26.925960269 +0000 UTC m=+4476.538170024" watchObservedRunningTime="2026-10-31 08:44:26.927549012 +0000 UTC m=+4476.539758780"
Oct 31 08:44:27.120770 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:27.120679    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:36.120639 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:36.120600    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:36.133120 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:36.133093    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:36.874383 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:36.874342    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:44:40.528145 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:44:40.528109    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:44:51.082663 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:51.082637    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:44:51.099775 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:51.099750    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:44:51.100551 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:51.100532    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:44:51.116916 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:44:51.116896    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:45:10.528188 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:45:10.528105    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:45:40.527306 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:45:40.527227    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:45:44.479830 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:44.479792    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:45:44.489018 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:45:44.488961    5872 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf" cmd=["/bin/sleep","15"]
Oct 31 08:45:44.489151 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:44.489037    5872 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 08:45:44.489151 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:45:44.489050    5872 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerName="main" containerID="cri-o://35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"
Oct 31 08:45:44.489151 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:44.489096    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerName="main" containerID="cri-o://35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf" gracePeriod=60
Oct 31 08:45:44.832371 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:44.832347    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:45:45.002444 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002365    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002444 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002419    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002452    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\" (UniqueName: \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002475    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002535    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002661 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002624    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\" (UniqueName: \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\") pod \"444fdf01-f21e-4be9-a2ee-1b180373851b\" (UID: \"444fdf01-f21e-4be9-a2ee-1b180373851b\") "
Oct 31 08:45:45.002886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002655    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:45:45.002886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002772    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:45:45.002886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002792    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:45:45.003068 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002919    5872 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-tmp-dir\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.003068 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002940    5872 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-model-cache\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.003068 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.002955    5872 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-home\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.004865 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.004842    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "kube-api-access-pmdnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:45:45.005185 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.005159    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:45:45.005293 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.005163    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm" pod "444fdf01-f21e-4be9-a2ee-1b180373851b" (UID: "444fdf01-f21e-4be9-a2ee-1b180373851b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:45:45.103618 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.103581    5872 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444fdf01-f21e-4be9-a2ee-1b180373851b-dshm\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.103618 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.103613    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444fdf01-f21e-4be9-a2ee-1b180373851b-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.103822 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.103632    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmdnh\" (UniqueName: \"kubernetes.io/projected/444fdf01-f21e-4be9-a2ee-1b180373851b-kube-api-access-pmdnh\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:45:45.170167 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.170130    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:45:45.170517 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.170505    5872 cpu_manager.go:414] "containerMap: removing container" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerName="main"
Oct 31 08:45:45.170560 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.170518    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerName="main"
Oct 31 08:45:45.170612 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.170603    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerName="main"
Oct 31 08:45:45.173817 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.173800    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.223377 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.223344    5872 generic.go:356] "Generic (PLEG): container finished" podID="444fdf01-f21e-4be9-a2ee-1b180373851b" containerID="35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf" exitCode=0
Oct 31 08:45:45.223508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.223389    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"
Oct 31 08:45:45.223508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.223427    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" event={"ID":"444fdf01-f21e-4be9-a2ee-1b180373851b","Type":"ContainerDied","Data":"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"}
Oct 31 08:45:45.223508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.223480    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp" event={"ID":"444fdf01-f21e-4be9-a2ee-1b180373851b","Type":"ContainerDied","Data":"e63a1e36fbc40316474af15d49da835a7889df4f4da86b27ebf65dbbe3603fd6"}
Oct 31 08:45:45.223508 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.223504    5872 scope.go:122] "RemoveContainer" containerID="35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"
Oct 31 08:45:45.226322 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.226300    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"openshift-service-ca.crt\""
Oct 31 08:45:45.226515 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.226496    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"default-dockercfg-j8q5x\""
Oct 31 08:45:45.226602 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.226495    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"kube-root-ca.crt\""
Oct 31 08:45:45.226602 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.226539    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"model-routing-only-7aad4d71-kserve-self-signed-certs\""
Oct 31 08:45:45.232439 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.232415    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:45:45.233714 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.233698    5872 scope.go:122] "RemoveContainer" containerID="35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"
Oct 31 08:45:45.234011 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:45:45.233989    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf\": container with ID starting with 35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf not found: ID does not exist" containerID="35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"
Oct 31 08:45:45.234079 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.234023    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf"} err="failed to get container status \"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf\": rpc error: code = NotFound desc = could not find container \"35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf\": container with ID starting with 35665d55e771f37a363b05c6e29315053de0510b66f52a02689e3bde7d5745bf not found: ID does not exist"
Oct 31 08:45:45.306141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306064    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.306141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306108    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.306141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306128    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.306348 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306238    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.306348 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306270    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7t2b\" (UniqueName: \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.306411 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.306360    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.398830 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.398799    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:45:45.405417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.405396    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-42hfp"]
Oct 31 08:45:45.407241 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407219    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407294 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407256    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407336 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407313    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407387 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407342    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7t2b\" (UniqueName: \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407442 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407408    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407498 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407455    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407789 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407761    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407905 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407808    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.407905 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.407847    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.409650 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.409623    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.410106 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.410079    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.465517 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.465488    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7t2b\" (UniqueName: \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.486283 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.486258    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:45.855821 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:45.855796    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:45:45.858223 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:45:45.858195    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd9c767_ca4d_4c40_a6d1_d9dd2304ab2f.slice/crio-b0f697e552bb5a4a2726bc7dae1a4ec834d2ad40666729373be480227fc3e7c6 WatchSource:0}: Error finding container b0f697e552bb5a4a2726bc7dae1a4ec834d2ad40666729373be480227fc3e7c6: Status 404 returned error can't find the container with id b0f697e552bb5a4a2726bc7dae1a4ec834d2ad40666729373be480227fc3e7c6
Oct 31 08:45:46.230860 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:46.230827    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" event={"ID":"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f","Type":"ContainerStarted","Data":"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"}
Oct 31 08:45:46.231048 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:46.230881    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" event={"ID":"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f","Type":"ContainerStarted","Data":"b0f697e552bb5a4a2726bc7dae1a4ec834d2ad40666729373be480227fc3e7c6"}
Oct 31 08:45:46.372876 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:46.372819    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" podStartSLOduration=1.372800007 podStartE2EDuration="1.372800007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:45:46.369444267 +0000 UTC m=+4555.981654013" watchObservedRunningTime="2026-10-31 08:45:46.372800007 +0000 UTC m=+4555.985009748"
Oct 31 08:45:46.486660 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:46.486568    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:46.508572 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:46.508536    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="444fdf01-f21e-4be9-a2ee-1b180373851b" path="/var/lib/kubelet/pods/444fdf01-f21e-4be9-a2ee-1b180373851b/volumes"
Oct 31 08:45:55.487225 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:55.487193    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:55.499450 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:55.499425    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:45:56.291363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:45:56.291336    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:46:10.527840 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:46:10.527802    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:46:40.527615 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:46:40.527528    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:47:05.472460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.472418    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:47:05.481724 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:47:05.481681    5872 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9" cmd=["/bin/sleep","15"]
Oct 31 08:47:05.481852 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.481743    5872 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 08:47:05.481852 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:47:05.481756    5872 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerName="main" containerID="cri-o://f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"
Oct 31 08:47:05.481852 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.481807    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerName="main" containerID="cri-o://f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9" gracePeriod=60
Oct 31 08:47:05.828924 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.828897    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:47:05.894810 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.894781    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895015 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.894841    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895015 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.894953    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\" (UniqueName: \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895019    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895069    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895105    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\") pod \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\" (UID: \"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f\") "
Oct 31 08:47:05.895156 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895128    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:47:05.895363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895305    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:47:05.895363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895318    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:47:05.895363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.895322    5872 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tmp-dir\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:05.897118 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.897084    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:47:05.897209 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.897158    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:47:05.897209 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.897191    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b" pod "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" (UID: "5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f"). InnerVolumeSpecName "kube-api-access-h7t2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:47:05.996732 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.996691    5872 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-home\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:05.996732 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.996729    5872 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-dshm\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:05.996921 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.996743    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:05.996921 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.996759    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7t2b\" (UniqueName: \"kubernetes.io/projected/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-kube-api-access-h7t2b\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:05.996921 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:05.996775    5872 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f-model-cache\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:47:06.640378 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.640343    5872 generic.go:356] "Generic (PLEG): container finished" podID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerID="f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9" exitCode=0
Oct 31 08:47:06.640816 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.640388    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"
Oct 31 08:47:06.640816 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.640426    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" event={"ID":"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f","Type":"ContainerDied","Data":"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"}
Oct 31 08:47:06.640816 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.640482    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9" event={"ID":"5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f","Type":"ContainerDied","Data":"b0f697e552bb5a4a2726bc7dae1a4ec834d2ad40666729373be480227fc3e7c6"}
Oct 31 08:47:06.640816 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.640506    5872 scope.go:122] "RemoveContainer" containerID="f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"
Oct 31 08:47:06.649814 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.649793    5872 scope.go:122] "RemoveContainer" containerID="f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"
Oct 31 08:47:06.650124 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:47:06.650097    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9\": container with ID starting with f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9 not found: ID does not exist" containerID="f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"
Oct 31 08:47:06.650189 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.650137    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9"} err="failed to get container status \"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9\": rpc error: code = NotFound desc = could not find container \"f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9\": container with ID starting with f865093254e8f5d61a895bbf1da7281aff7a2d22975e7d129d29a36676bf68e9 not found: ID does not exist"
Oct 31 08:47:06.826947 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.826865    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:47:06.829378 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:06.829352    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-f5kk9"]
Oct 31 08:47:08.508180 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:47:08.508147    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" path="/var/lib/kubelet/pods/5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f/volumes"
Oct 31 08:47:10.527033 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:47:10.526997    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:47:40.527687 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:47:40.527573    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:48:10.386940 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.386842    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:48:10.387468 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.387447    5872 cpu_manager.go:414] "containerMap: removing container" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerName="main"
Oct 31 08:48:10.387540 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.387473    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerName="main"
Oct 31 08:48:10.387610 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.387595    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="5dd9c767-ca4d-4c40-a6d1-d9dd2304ab2f" containerName="main"
Oct 31 08:48:10.390618 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.390597    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.456517 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.456483    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.456670 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.456628    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvpf5\" (UniqueName: \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.477363 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.477334    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"kube-root-ca.crt\""
Oct 31 08:48:10.477503 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.477380    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"openshift-service-ca.crt\""
Oct 31 08:48:10.494223 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.494194    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Oct 31 08:48:10.494404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.494392    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"default-dockercfg-xwjcc\""
Oct 31 08:48:10.494691 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.494673    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-epp-sa-dockercfg-cp44x\""
Oct 31 08:48:10.496988 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.496953    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:48:10.527135 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:48:10.527108    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:48:10.557108 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.557075    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvpf5\" (UniqueName: \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.557270 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.557129    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.559585 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.559554    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.614701 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.614670    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvpf5\" (UniqueName: \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:10.703166 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:10.703130    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:11.074160 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:11.074136    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:48:11.076540 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:48:11.076511    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4df5c39_4c3b_4e99_93bc_da74e10e24a0.slice/crio-0ed2aa67e1bde5116ec56d5d3f8fdf3522774dfff8d612aaf7c5f65d5e340045 WatchSource:0}: Error finding container 0ed2aa67e1bde5116ec56d5d3f8fdf3522774dfff8d612aaf7c5f65d5e340045: Status 404 returned error can't find the container with id 0ed2aa67e1bde5116ec56d5d3f8fdf3522774dfff8d612aaf7c5f65d5e340045
Oct 31 08:48:11.967922 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:11.967878    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" event={"ID":"a4df5c39-4c3b-4e99-93bc-da74e10e24a0","Type":"ContainerStarted","Data":"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"}
Oct 31 08:48:11.968490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:11.967943    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:11.968490 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:11.967990    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" event={"ID":"a4df5c39-4c3b-4e99-93bc-da74e10e24a0","Type":"ContainerStarted","Data":"0ed2aa67e1bde5116ec56d5d3f8fdf3522774dfff8d612aaf7c5f65d5e340045"}
Oct 31 08:48:12.085228 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:12.085177    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podStartSLOduration=2.085162873 podStartE2EDuration="2.085162873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:48:12.083504408 +0000 UTC m=+4701.695714150" watchObservedRunningTime="2026-10-31 08:48:12.085162873 +0000 UTC m=+4701.697372615"
Oct 31 08:48:40.528001 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:48:40.527946    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:48:42.895748 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.895710    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"]
Oct 31 08:48:42.899453 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.899437    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.920943 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.920918    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921070 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.920954    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921070 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.920995    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921152 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921089    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921152 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921123    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8c142aa-68ec-476a-b32c-c4198b734107-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921230 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921192    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8c142aa-68ec-476a-b32c-c4198b734107-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921230 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921221    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921243    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgsc\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-kube-api-access-5pgsc\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.921346 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.921261    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:42.978150 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:42.978123    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:48:43.004084 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.004052    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"]
Oct 31 08:48:43.022047 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022021    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8c142aa-68ec-476a-b32c-c4198b734107-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022175 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022089    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8c142aa-68ec-476a-b32c-c4198b734107-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022175 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022116    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022175 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022134    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgsc\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-kube-api-access-5pgsc\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022175 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022163    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022352 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022225    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022352 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022256    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022725 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022674    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-data\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022844 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022771    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-credential-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.022952 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.022931    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.023090 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.023064    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-socket\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.023269 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.023088    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.023373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.023181    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8c142aa-68ec-476a-b32c-c4198b734107-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.023373 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.023314    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-workload-certs\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.024648 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.024626    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8c142aa-68ec-476a-b32c-c4198b734107-istio-envoy\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.024789 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.024763    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8c142aa-68ec-476a-b32c-c4198b734107-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.079188 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.079149    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-istio-token\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.079458 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.079245    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgsc\" (UniqueName: \"kubernetes.io/projected/a8c142aa-68ec-476a-b32c-c4198b734107-kube-api-access-5pgsc\") pod \"openshift-ai-inference-openshift-default-56f46b8cdd-66lgt\" (UID: \"a8c142aa-68ec-476a-b32c-c4198b734107\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.213107 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.213071    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:43.638052 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.638026    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"]
Oct 31 08:48:43.640485 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:48:43.640453    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c142aa_68ec_476a_b32c_c4198b734107.slice/crio-471b1d9700003e53ab126b95f750f0ad0dfb6e114d67a2566cabd1eee8c7c3a9 WatchSource:0}: Error finding container 471b1d9700003e53ab126b95f750f0ad0dfb6e114d67a2566cabd1eee8c7c3a9: Status 404 returned error can't find the container with id 471b1d9700003e53ab126b95f750f0ad0dfb6e114d67a2566cabd1eee8c7c3a9
Oct 31 08:48:43.642495 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.642458    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:48:43.642601 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.642537    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:48:43.642601 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:43.642584    5872 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 31 08:48:44.142782 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.142745    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" event={"ID":"a8c142aa-68ec-476a-b32c-c4198b734107","Type":"ContainerStarted","Data":"7a7992f53a3d6717a1db2b7879c929eee775fd2320371347f012807b42e6c268"}
Oct 31 08:48:44.143216 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.142800    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" event={"ID":"a8c142aa-68ec-476a-b32c-c4198b734107","Type":"ContainerStarted","Data":"471b1d9700003e53ab126b95f750f0ad0dfb6e114d67a2566cabd1eee8c7c3a9"}
Oct 31 08:48:44.213606 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.213565    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:44.215125 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.215095    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:44.215263 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.215151    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:44.264911 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:44.264665    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podStartSLOduration=2.264643393 podStartE2EDuration="2.264643393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:48:44.261669936 +0000 UTC m=+4733.873879676" watchObservedRunningTime="2026-10-31 08:48:44.264643393 +0000 UTC m=+4733.876853136"
Oct 31 08:48:45.213824 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:45.213789    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:45.214249 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:45.213839    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:46.213641 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:46.213603    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:46.213824 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:46.213660    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:47.213637 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:47.213602    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:47.214050 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:47.213660    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:48.213703 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:48.213666    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:48.214141 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:48.213721    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:49.213843 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:49.213806    5872 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 31 08:48:49.214261 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:49.213860    5872 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt" podUID="a8c142aa-68ec-476a-b32c-c4198b734107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 31 08:48:50.217158 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:50.217127    5872 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:50.217641 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:50.217385    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:50.218137 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:50.218121    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-56f46b8cdd-66lgt"
Oct 31 08:48:55.906656 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:48:55.906613    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:49:02.977997 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:02.977930    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:49:10.530779 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:49:10.530742    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:49:10.926410 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:10.926376    5872 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main" containerID="cri-o://54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45" gracePeriod=45
Oct 31 08:49:12.978113 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:12.978073    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:49:22.977258 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:22.977220    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:49:22.977722 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:22.977331    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:49:32.978275 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:32.978194    5872 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 08:49:40.528368 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:49:40.528331    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:49:41.168173 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.168142    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:49:41.267083 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.266990    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\") pod \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") "
Oct 31 08:49:41.267253 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.267082    5872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\" (UniqueName: \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\") pod \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\" (UID: \"a4df5c39-4c3b-4e99-93bc-da74e10e24a0\") "
Oct 31 08:49:41.269195 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.269165    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5" pod "a4df5c39-4c3b-4e99-93bc-da74e10e24a0" (UID: "a4df5c39-4c3b-4e99-93bc-da74e10e24a0"). InnerVolumeSpecName "kube-api-access-pvpf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:49:41.269313 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.269210    5872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs" pod "a4df5c39-4c3b-4e99-93bc-da74e10e24a0" (UID: "a4df5c39-4c3b-4e99-93bc-da74e10e24a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:49:41.368208 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.368169    5872 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-tls-certs\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:49:41.368208 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.368204    5872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvpf5\" (UniqueName: \"kubernetes.io/projected/a4df5c39-4c3b-4e99-93bc-da74e10e24a0-kube-api-access-pvpf5\") on node \"ip-10-0-140-145.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 08:49:41.453241 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.453201    5872 generic.go:356] "Generic (PLEG): container finished" podID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerID="54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45" exitCode=0
Oct 31 08:49:41.453404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.453250    5872 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"
Oct 31 08:49:41.453404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.453284    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" event={"ID":"a4df5c39-4c3b-4e99-93bc-da74e10e24a0","Type":"ContainerDied","Data":"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"}
Oct 31 08:49:41.453404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.453336    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s" event={"ID":"a4df5c39-4c3b-4e99-93bc-da74e10e24a0","Type":"ContainerDied","Data":"0ed2aa67e1bde5116ec56d5d3f8fdf3522774dfff8d612aaf7c5f65d5e340045"}
Oct 31 08:49:41.453404 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.453363    5872 scope.go:122] "RemoveContainer" containerID="54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"
Oct 31 08:49:41.462728 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.462706    5872 scope.go:122] "RemoveContainer" containerID="54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"
Oct 31 08:49:41.462951 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:49:41.462935    5872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45\": container with ID starting with 54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45 not found: ID does not exist" containerID="54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"
Oct 31 08:49:41.463027 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.462959    5872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45"} err="failed to get container status \"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45\": rpc error: code = NotFound desc = could not find container \"54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45\": container with ID starting with 54c34b327cb7dafaebf6d21890e365e4825109359a50a3d49d4aa52cdc667e45 not found: ID does not exist"
Oct 31 08:49:41.620389 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.620311    5872 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:49:41.624417 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:41.624394    5872 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-m295s"]
Oct 31 08:49:42.508084 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:42.508048    5872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" path="/var/lib/kubelet/pods/a4df5c39-4c3b-4e99-93bc-da74e10e24a0/volumes"
Oct 31 08:49:51.118099 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:51.118072    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:49:51.136357 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:51.136334    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:49:51.138103 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:51.138082    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg8n25_c3428f00-5b59-4790-814d-1c791349ffbf/extract/0.log"
Oct 31 08:49:51.154606 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:49:51.154589    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7mvb_958faca4-910f-457f-8f09-ce70c47b6fed/ovn-acl-logging/0.log"
Oct 31 08:50:10.527335 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:50:10.527300    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:50:40.526790 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:50:40.526754    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:50:58.427585 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:50:58.427548    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwm9t_db395804-feb8-4f46-a0ea-6af7ddd7cd4b/discovery/0.log"
Oct 31 08:50:58.603133 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:50:58.603103    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n_5a3fbeb3-09d0-4095-8006-407a691b559c/istio-proxy/0.log"
Oct 31 08:50:58.812528 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:50:58.812414    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56f46b8cdd-66lgt_a8c142aa-68ec-476a-b32c-c4198b734107/istio-proxy/0.log"
Oct 31 08:51:03.408523 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:03.408487    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwm9t_db395804-feb8-4f46-a0ea-6af7ddd7cd4b/discovery/0.log"
Oct 31 08:51:03.696737 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:03.696705    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56f46b8cdd-2fd6n_5a3fbeb3-09d0-4095-8006-407a691b559c/istio-proxy/0.log"
Oct 31 08:51:03.915696 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:03.915665    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-56f46b8cdd-66lgt_a8c142aa-68ec-476a-b32c-c4198b734107/istio-proxy/0.log"
Oct 31 08:51:09.177492 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:09.177464    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-pdw96_1381480d-ca82-436b-90be-2ed2fe060f02/limitador/0.log"
Oct 31 08:51:09.389790 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:09.389757    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-69b7bb8c5c-mflcb_7547ba70-7b80-4629-9a56-b5050e891e2b/manager/0.log"
Oct 31 08:51:10.527912 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:51:10.527871    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:51:14.439597 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.439562    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9rj77/must-gather-crh7f"]
Oct 31 08:51:14.440011 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.439996    5872 cpu_manager.go:414] "containerMap: removing container" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main"
Oct 31 08:51:14.440061 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.440012    5872 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main"
Oct 31 08:51:14.440100 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.440093    5872 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4df5c39-4c3b-4e99-93bc-da74e10e24a0" containerName="main"
Oct 31 08:51:14.443318 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.443300    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.482456 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.482425    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-must-gather-output\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.482575 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.482534    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvht\" (UniqueName: \"kubernetes.io/projected/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-kube-api-access-8lvht\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.496542 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.496518    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9rj77\"/\"openshift-service-ca.crt\""
Oct 31 08:51:14.545886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.545857    5872 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9rj77\"/\"kube-root-ca.crt\""
Oct 31 08:51:14.546080 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.545957    5872 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9rj77\"/\"default-dockercfg-wfbtx\""
Oct 31 08:51:14.547699 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.547673    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rj77/must-gather-crh7f"]
Oct 31 08:51:14.583340 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.583309    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvht\" (UniqueName: \"kubernetes.io/projected/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-kube-api-access-8lvht\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.583453 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.583372    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-must-gather-output\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.583739 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.583720    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-must-gather-output\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.641312 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.641289    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvht\" (UniqueName: \"kubernetes.io/projected/638aa88a-21b0-40aa-9f33-7b7bf2c1332a-kube-api-access-8lvht\") pod \"must-gather-crh7f\" (UID: \"638aa88a-21b0-40aa-9f33-7b7bf2c1332a\") " pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:14.757460 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:14.757381    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rj77/must-gather-crh7f"
Oct 31 08:51:15.132037 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:15.132006    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rj77/must-gather-crh7f"]
Oct 31 08:51:15.134481 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:51:15.134451    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod638aa88a_21b0_40aa_9f33_7b7bf2c1332a.slice/crio-e913036e71a1048cbfc313323815f14282489c0babe2d4d83f2a366725d227c8 WatchSource:0}: Error finding container e913036e71a1048cbfc313323815f14282489c0babe2d4d83f2a366725d227c8: Status 404 returned error can't find the container with id e913036e71a1048cbfc313323815f14282489c0babe2d4d83f2a366725d227c8
Oct 31 08:51:15.136719 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:15.136697    5872 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 08:51:15.926090 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:15.926053    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rj77/must-gather-crh7f" event={"ID":"638aa88a-21b0-40aa-9f33-7b7bf2c1332a","Type":"ContainerStarted","Data":"e913036e71a1048cbfc313323815f14282489c0babe2d4d83f2a366725d227c8"}
Oct 31 08:51:16.932557 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:16.932520    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rj77/must-gather-crh7f" event={"ID":"638aa88a-21b0-40aa-9f33-7b7bf2c1332a","Type":"ContainerStarted","Data":"1b9ad4e6ec5de03ecdd1a75b8c4af207f3ab7d4a987780dab620feeb49cddc7f"}
Oct 31 08:51:16.932952 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:16.932571    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rj77/must-gather-crh7f" event={"ID":"638aa88a-21b0-40aa-9f33-7b7bf2c1332a","Type":"ContainerStarted","Data":"4ed2b47ab74e7ea87fe5c0afa85e0cf8df91f75030e42893fa4a7486a361e27f"}
Oct 31 08:51:17.048611 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:17.048555    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-9rj77/must-gather-crh7f" podStartSLOduration=1.7144564839999998 podStartE2EDuration="3.048540241s" totalImagesPullingTime="1.334083757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:51:17.04689709 +0000 UTC m=+4886.659106849" watchObservedRunningTime="2026-10-31 08:51:17.048540241 +0000 UTC m=+4886.660749982"
Oct 31 08:51:24.352613 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:24.352578    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mlgpz_7e23265d-162b-4b43-9b34-2f66f5cbd362/global-pull-secret-syncer/0.log"
Oct 31 08:51:26.566987 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:26.566458    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rhw4q_36fe2da9-e59f-4b74-b99f-d1158fe8a08a/konnectivity-agent/0.log"
Oct 31 08:51:28.209224 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:28.209190    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-145.us-west-1.compute.internal_9d8d2bd7442930f2267d92c4a39b2cf9/haproxy/0.log"
Oct 31 08:51:35.676274 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:35.676239    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-pdw96_1381480d-ca82-436b-90be-2ed2fe060f02/limitador/0.log"
Oct 31 08:51:36.093124 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.093036    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-69b7bb8c5c-mflcb_7547ba70-7b80-4629-9a56-b5050e891e2b/manager/0.log"
Oct 31 08:51:36.740397 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.740359    5872 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"]
Oct 31 08:51:36.746163 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.746137    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.835348 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.835313    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"]
Oct 31 08:51:36.885303 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.885260    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-sys\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.885473 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.885316    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-proc\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.885473 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.885382    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njcc8\" (UniqueName: \"kubernetes.io/projected/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-kube-api-access-njcc8\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.885473 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.885441    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-podres\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.885578 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.885495    5872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-lib-modules\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986264 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986228    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-sys\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986272    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-proc\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986296    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njcc8\" (UniqueName: \"kubernetes.io/projected/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-kube-api-access-njcc8\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986316    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-podres\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986354    5872 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-lib-modules\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986367    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-sys\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986367    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-proc\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986414    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-podres\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:36.986454 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:36.986436    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-lib-modules\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:37.043565 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:37.043492    5872 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njcc8\" (UniqueName: \"kubernetes.io/projected/c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a-kube-api-access-njcc8\") pod \"perf-node-gather-daemonset-xq28j\" (UID: \"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a\") " pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:37.061815 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:37.061787    5872 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:37.435281 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:37.435252    5872 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"]
Oct 31 08:51:37.437083 ip-10-0-140-145 kubenswrapper[5872]: W1031 08:51:37.437045    5872 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc85c968e_a5ab_4ac7_9c66_a8ebc27ac82a.slice/crio-f3086cd91aac988c0f318b0e39ea6e4677940ee3bf4591d41409a31b6b4040ef WatchSource:0}: Error finding container f3086cd91aac988c0f318b0e39ea6e4677940ee3bf4591d41409a31b6b4040ef: Status 404 returned error can't find the container with id f3086cd91aac988c0f318b0e39ea6e4677940ee3bf4591d41409a31b6b4040ef
Oct 31 08:51:38.082064 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:38.082031    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j" event={"ID":"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a","Type":"ContainerStarted","Data":"9621d53a9e3c5c6d0bbc765bdc9832386df53fb99457ac81b21860416f8d5261"}
Oct 31 08:51:38.082438 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:38.082083    5872 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j" event={"ID":"c85c968e-a5ab-4ac7-9c66-a8ebc27ac82a","Type":"ContainerStarted","Data":"f3086cd91aac988c0f318b0e39ea6e4677940ee3bf4591d41409a31b6b4040ef"}
Oct 31 08:51:38.082438 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:38.082169    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:38.196898 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:38.196838    5872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j" podStartSLOduration=2.1968240310000002 podStartE2EDuration="2.196824031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 08:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:51:38.195924729 +0000 UTC m=+4907.808134474" watchObservedRunningTime="2026-10-31 08:51:38.196824031 +0000 UTC m=+4907.809033772"
Oct 31 08:51:38.607446 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:38.607416    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/alertmanager/0.log"
Oct 31 08:51:39.020886 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:39.020859    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/config-reloader/0.log"
Oct 31 08:51:39.434902 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:39.434876    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/kube-rbac-proxy-web/0.log"
Oct 31 08:51:39.848635 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:39.848550    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/kube-rbac-proxy/0.log"
Oct 31 08:51:40.262237 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:40.262209    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/kube-rbac-proxy-metric/0.log"
Oct 31 08:51:40.528583 ip-10-0-140-145 kubenswrapper[5872]: E1031 08:51:40.528487    5872 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-j5d2p" containerName="extractor"
Oct 31 08:51:40.675561 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:40.675529    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/prom-label-proxy/0.log"
Oct 31 08:51:41.088874 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:41.088846    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_951ec597-58ce-4137-ab0d-a749323ad7f9/init-config-reloader/0.log"
Oct 31 08:51:41.926531 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:41.926497    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-6ncgk_2af2e3d9-141c-487f-af2e-b1505e4ae1bc/kube-state-metrics/0.log"
Oct 31 08:51:42.336189 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:42.336112    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-6ncgk_2af2e3d9-141c-487f-af2e-b1505e4ae1bc/kube-rbac-proxy-main/0.log"
Oct 31 08:51:42.748838 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:42.748810    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-6ncgk_2af2e3d9-141c-487f-af2e-b1505e4ae1bc/kube-rbac-proxy-self/0.log"
Oct 31 08:51:43.164805 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:43.164775    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-667fc5fff6-zmrzv_7ede69ed-3423-4f3c-b38a-d14f2fe14d0c/metrics-server/0.log"
Oct 31 08:51:43.581848 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:43.581769    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-gdmrv_60fed36f-e2d8-405b-8ce2-d66a797f1472/monitoring-plugin/0.log"
Oct 31 08:51:44.098066 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:44.098036    5872 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9rj77/perf-node-gather-daemonset-xq28j"
Oct 31 08:51:45.252197 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:45.252156    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2v75_49854e3c-2db5-4729-9c2f-aca619b2adaa/node-exporter/0.log"
Oct 31 08:51:45.664769 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:45.664745    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2v75_49854e3c-2db5-4729-9c2f-aca619b2adaa/kube-rbac-proxy/0.log"
Oct 31 08:51:46.077707 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:46.077635    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2v75_49854e3c-2db5-4729-9c2f-aca619b2adaa/init-textfile/0.log"
Oct 31 08:51:47.739297 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:47.739268    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-drb5w_eae92750-8a5b-4d75-95a7-371bbfc83749/kube-rbac-proxy-main/0.log"
Oct 31 08:51:48.152642 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:48.152565    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-drb5w_eae92750-8a5b-4d75-95a7-371bbfc83749/kube-rbac-proxy-self/0.log"
Oct 31 08:51:48.564478 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:48.564434    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-drb5w_eae92750-8a5b-4d75-95a7-371bbfc83749/openshift-state-metrics/0.log"
Oct 31 08:51:51.893037 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:51.893006    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8dn96_eaa2361c-1e80-4fec-aca7-57e67cc2c905/prometheus-operator/0.log"
Oct 31 08:51:52.301207 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:52.301178    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8dn96_eaa2361c-1e80-4fec-aca7-57e67cc2c905/kube-rbac-proxy/0.log"
Oct 31 08:51:52.717092 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:52.717061    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-sf77f_d82d0ab7-dbcd-4622-b5c8-1c1f543a8bf3/prometheus-operator-admission-webhook/0.log"
Oct 31 08:51:53.134599 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:53.134511    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c79f89bf5-z6bkf_726ecee9-61d2-4025-b198-7ff457b6cbbb/telemeter-client/0.log"
Oct 31 08:51:53.547538 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:53.547512    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c79f89bf5-z6bkf_726ecee9-61d2-4025-b198-7ff457b6cbbb/reload/0.log"
Oct 31 08:51:53.958795 ip-10-0-140-145 kubenswrapper[5872]: I1031 08:51:53.958764    5872 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c79f89bf5-z6bkf_726ecee9-61d2-4025-b198-7ff457b6cbbb/kube-rbac-proxy/0.log"