Oct 31 00:28:42.465940 ip-10-0-143-57 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:28:42.905817 ip-10-0-143-57 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:28:42.905817 ip-10-0-143-57 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:28:42.905817 ip-10-0-143-57 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:28:42.905817 ip-10-0-143-57 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:28:42.910236 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910126    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.910236 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910237    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.910236 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910241    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910244    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910247    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910250    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910254    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910259    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910263    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910266    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910269    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910272    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910274    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910277    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910287    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910290    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910292    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910295    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910297    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910300    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910302    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.910326 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910306    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910308    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910311    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910314    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910316    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910319    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910322    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910324    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910327    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910330    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910333    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910336    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910339    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910342    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910344    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910347    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910349    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910351    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910354    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.910859 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910356    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910359    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910361    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910363    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910366    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910368    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910371    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910374    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910377    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910380    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910382    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910384    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910387    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910389    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910391    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910395    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910397    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910400    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910403    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910406    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.911301 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910408    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910411    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910414    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910416    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910419    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910421    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910424    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910426    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910429    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910431    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910434    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910436    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910439    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910441    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910444    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910446    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910449    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910451    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910454    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.911814 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910456    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910459    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910462    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910464    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910466    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910469    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910471    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910474    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910477    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910480    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910482    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910486    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910489    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910492    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910494    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910497    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910499    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910502    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910504    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910507    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910510    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.912255 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910512    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910516    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910520    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910523    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910526    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.910529    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911345    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911352    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911355    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911357    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911360    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911362    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911365    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911368    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911371    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911373    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911376    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911379    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911382    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.912752 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911386    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911388    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911391    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911394    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911397    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911399    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911402    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911404    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911407    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911409    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911412    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911416    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911420    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911423    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911426    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911429    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911431    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911434    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911436    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.913195 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911439    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911441    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911443    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911446    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911449    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911451    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911454    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911457    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911459    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911462    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911465    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911468    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911470    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911476    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911478    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911481    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911483    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911486    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911488    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.913644 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911491    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911493    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911496    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911498    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911500    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911503    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911505    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911509    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911511    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911514    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911516    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911518    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911521    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911523    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911526    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911528    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911530    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911533    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911536    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.914123 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911538    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911540    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911543    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911549    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911552    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911554    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911557    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911562    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911565    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911568    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911570    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911572    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911575    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911577    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911580    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911582    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911584    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911587    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911589    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911592    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.914650 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911611    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911614    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911616    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911619    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911621    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911624    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911626    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911629    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911631    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911634    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911637    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911639    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911643    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911647    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911649    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.911652    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912126    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912130    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912133    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912138    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.915161 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912141    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912144    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912148    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912151    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912153    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912156    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912159    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912161    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912163    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912166    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912168    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912171    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912174    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912176    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912178    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912182    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912186    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912189    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912192    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.915674 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912195    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912197    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912200    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912202    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912205    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912207    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912209    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912212    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912214    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912217    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912220    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912222    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912228    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912231    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912234    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912237    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912239    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912242    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912244    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912247    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.916104 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912250    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912252    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912254    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912257    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912260    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912262    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912265    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912268    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912270    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912273    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912275    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912278    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912280    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912283    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912286    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912289    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912291    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912294    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912296    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912299    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.916581 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912301    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912303    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912306    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912309    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912314    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912316    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912319    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912321    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912323    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912326    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912329    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912331    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912334    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912336    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912338    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912341    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912343    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912346    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912348    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912351    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.917064 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912353    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912356    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912358    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912360    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912363    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912365    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912368    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912370    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912373    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912375    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912378    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912380    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912382    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912385    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912387    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912390    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912394    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912397    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912399    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.917521 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912402    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912404    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912407    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.912411    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913486    2580 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913496    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913504    2580 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913509    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913513    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913516    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913520    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913525    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913528    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913531    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913535    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913539    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913542    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913545    2580 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913547    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913550    2580 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913553    2580 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913556    2580 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913560    2580 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913563    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:28:42.917965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913566    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913569    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913573    2580 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913577    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913580    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913586    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913589    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913592    2580 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913606    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913609    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913613    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913616    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913620    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913623    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913626    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913629    2580 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913632    2580 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913635    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913640    2580 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913643    2580 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913646    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913649    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913652    2580 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913656    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:28:42.918494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913660    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913663    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913666    2580 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913669    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913672    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913674    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913677    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913680    2580 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913683    2580 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913686    2580 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913691    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913694    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913697    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913701    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913705    2580 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913708    2580 flags.go:64] FLAG: --help="false"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913711    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913714    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913717    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913720    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913723    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913726    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913729    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:28:42.919128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913732    2580 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913734    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913737    2580 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913740    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913743    2580 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913746    2580 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913748    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913751    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913754    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913757    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913759    2580 flags.go:64] FLAG: --lock-file=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913762    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913765    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913768    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913774    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913776    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913779    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913782    2580 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913785    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913788    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913791    2580 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913793    2580 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913800    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913803    2580 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913807    2580 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:28:42.919674 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913811    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913814    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913817    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913819    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913822    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913825    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913828    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913835    2580 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913838    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913841    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913844    2580 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913847    2580 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913849    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913852    2580 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913855    2580 flags.go:64] FLAG: --port="10250"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913858    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913861    2580 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-075e7b268782ec67d"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913864    2580 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913867    2580 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913870    2580 flags.go:64] FLAG: --register-node="true"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913873    2580 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913877    2580 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913880    2580 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913882    2580 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913885    2580 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913889    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:28:42.920308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913892    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913895    2580 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913898    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913902    2580 flags.go:64] FLAG: --runonce="false"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913905    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913908    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913912    2580 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913915    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913917    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913921    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913924    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913927    2580 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913930    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913932    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913935    2580 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913938    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913941    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913944    2580 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913947    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913952    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913955    2580 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913958    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913961    2580 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913964    2580 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913967    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:28:42.920946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913970    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913973    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913976    2580 flags.go:64] FLAG: --v="2"
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913981    2580 flags.go:64] FLAG: --version="false"
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913985    2580 flags.go:64] FLAG: --vmodule=""
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913988    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.913991    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915159    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915173    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915178    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915191    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915196    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915201    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915205    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915221    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915226    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915230    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915234    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915243    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915250    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.921530 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915319    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915441    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915449    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915453    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915457    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915461    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915466    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915471    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915475    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915479    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915483    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915487    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915492    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915496    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915500    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915504    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915508    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915512    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915517    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.922011 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915521    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915525    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915529    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915534    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915539    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915545    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915550    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915556    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915560    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915566    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915571    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915575    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915579    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915584    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915590    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915613    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915620    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915624    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915629    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.922460 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915633    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915637    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915641    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915646    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915650    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915654    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915658    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915662    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915666    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915671    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915675    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915678    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915681    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915684    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915686    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915689    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915692    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915694    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915697    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915699    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.922974 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915702    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915704    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915707    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915710    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915713    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915715    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915718    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915721    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915724    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915726    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915729    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915732    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915735    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915738    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915741    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915743    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915746    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915748    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915751    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915753    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.923444 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915756    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915761    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915763    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915766    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915768    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915771    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915773    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915776    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915779    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915781    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915784    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915786    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915789    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915791    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915794    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.915829    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:28:42.923947 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915869    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915874    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915877    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915882    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915885    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915887    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915889    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915892    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915896    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915900    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915903    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915905    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915908    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915910    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915913    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915915    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915918    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915920    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915924    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915926    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.924318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915929    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915932    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915935    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915938    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915940    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915943    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915945    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915947    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915950    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915952    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915955    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915957    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915959    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915962    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915965    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915968    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915971    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915974    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915976    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915979    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.924856 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915981    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915984    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915986    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915989    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915992    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915994    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915997    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.915999    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916001    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916004    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916008    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916011    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916013    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916016    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916018    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916021    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916024    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916026    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916028    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916031    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.925321 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916033    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916036    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916038    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916041    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916044    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916046    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916048    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916053    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916056    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916060    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916062    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916065    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916067    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916069    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916072    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916075    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916078    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916081    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.925795 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916083    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916087    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916091    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916093    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916097    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916100    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916102    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916105    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916108    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916111    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916114    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916116    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916119    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916121    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916124    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916126    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916129    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916131    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916134    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.926206 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916136    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916139    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916142    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916145    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916147    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916150    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916152    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916155    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.916159    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.923276    2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.923296    2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.923313    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.923319    2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923380    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923387    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923391    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923394    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923397    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923400    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.926675 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923403    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923405    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923408    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923410    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923413    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923416    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923418    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923421    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923423    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923426    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923429    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923431    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923434    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923436    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923439    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923441    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923444    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923447    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923450    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923452    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.927113 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923455    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923458    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923460    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923464    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923468    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923470    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923473    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923475    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923478    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923480    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923482    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923485    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923488    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923490    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923493    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923495    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923498    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923500    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923502    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923505    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.927727 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923507    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923510    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923512    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923515    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923517    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923520    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923522    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923525    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923527    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923530    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923532    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923534    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923537    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923540    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923542    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923546    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923549    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923554    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923557    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.928198 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923559    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923562    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923564    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923567    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923569    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923572    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923574    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923577    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923580    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923582    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923586    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923590    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923607    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923611    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923613    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923616    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923620    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923624    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923627    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.928672 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923629    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923632    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923635    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923637    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923640    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923643    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923645    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923648    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923650    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923653    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923656    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923658    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923661    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923664    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923667    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923669    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923672    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923674    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923677    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923679    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.929110 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923682    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923684    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.923711    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923850    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923854    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923857    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923859    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923862    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923865    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923868    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923870    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923873    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923876    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923878    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923881    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923883    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.929572 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923886    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923888    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923891    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923893    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923895    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923898    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923901    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923904    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923907    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923910    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923913    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923915    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923918    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923921    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923923    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923925    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923928    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923931    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923933    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.929958 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923935    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923938    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923940    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923943    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923945    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923948    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923950    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923953    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923956    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923958    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923961    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923964    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923966    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923969    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923971    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923974    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923977    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923980    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923982    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.930394 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923985    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923988    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923991    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923993    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923996    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.923999    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924001    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924004    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924007    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924009    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924012    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924014    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924016    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924019    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924021    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924024    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924027    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924029    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924031    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924034    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.930864 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924036    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924039    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924042    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924044    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924046    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924049    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924051    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924054    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924058    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924061    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924064    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924067    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924070    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924072    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924075    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924078    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924080    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924085    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924088    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.931318 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924091    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924093    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924096    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924098    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924101    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924103    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924106    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924108    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924111    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924113    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924116    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924118    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924120    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924123    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924125    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924128    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.931773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.924151    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924183    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924187    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924190    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924193    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924195    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924198    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924201    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924205    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924208    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924212    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924215    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924217    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924220    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924223    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924226    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924229    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924231    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924234    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924237    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:28:42.932135 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924239    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924242    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924244    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924246    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924249    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924253    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924257    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924260    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924264    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924266    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924269    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924272    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924274    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924277    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924280    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924283    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924286    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924289    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924291    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:28:42.932607 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924293    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924297    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924300    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924304    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924307    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924309    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924312    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924314    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924317    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924320    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924323    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924325    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924328    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924331    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924333    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924336    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924339    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924341    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924344    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:28:42.933070 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924346    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924349    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924351    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924354    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924357    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924359    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924362    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924364    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924367    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924369    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924372    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924374    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924377    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924379    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924384    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924386    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924389    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924392    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924395    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924397    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:28:42.933501 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924400    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924402    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924405    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924408    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924410    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924413    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924415    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924418    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924420    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924423    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924425    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924428    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924430    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924433    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924435    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924438    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924440    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924442    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924445    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924449    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:28:42.933976 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924451    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924454    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924456    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924459    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924461    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924464    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924468    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924470    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:42.924473    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.924528    2580 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.927093    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.928101    2580 server.go:1014] "Starting client certificate rotation"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.928198    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.928228    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.930694    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:28:42.934445 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.931912    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:28:42.945814 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.945797    2580 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:28:42.950972 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.950116    2580 log.go:25] "Validated CRI v1 image API"
Oct 31 00:28:42.951683 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.951653    2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:28:42.956245 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.956223    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9bf6b89d-9300-4124-8c38-a2697e736e07:/dev/nvme0n1p4 b0071800-e8ae-4b62-a0fc-e4debfddf8d5:/dev/nvme0n1p3]
Oct 31 00:28:42.956298 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.956246    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 00:28:42.960974 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.960861    2580 manager.go:217] Machine: {Timestamp:2026-10-31 00:28:42.960365672 +0000 UTC m=+0.370902291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096117 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da62a910568aa63c0309cb3bc0c7a SystemUUID:ec2da62a-9105-68aa-63c0-309cb3bc0c7a BootID:eaadee93-d039-4d89-87f0-512f4d651297 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:f4:69:0a:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:f4:69:0a:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:0b:cd:ca:ad:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:28:42.961553 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.961543    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:28:42.961661 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.961648    2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:28:42.964668 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.964643    2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:28:42.964807 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.964669    2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-57.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:28:42.964851 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.964809    2580 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:28:42.964851 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.964816    2580 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:28:42.964851 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.964839    2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:28:42.966492 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.966482    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:28:42.967510 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.967499    2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:28:42.970859 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.970847    2580 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:28:42.970983 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.970973    2580 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:28:42.971659 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.971649    2580 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:28:42.971712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.971661    2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:28:42.971712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.971677    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:28:42.971712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.971687    2580 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:28:42.971712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.971695    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:28:42.972076 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.972060    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:28:42.974399 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.974381    2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:28:42.980296 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.980283    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:28:42.981154 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981141    2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:28:42.981192 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981172    2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:28:42.981351 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981341    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:28:42.981387 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981357    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:28:42.981387 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981364    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:28:42.981387 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981370    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:28:42.981387 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981375    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:28:42.981387 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.981380    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:28:42.982082 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982073    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:28:42.982082 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982083    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:28:42.982142 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982090    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:28:42.982142 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982096    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:28:42.982142 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982105    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:28:42.982142 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.982114    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:28:42.983785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.983773    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:28:42.983785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.983786    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:28:42.987796 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.987781    2580 server.go:1263] "Started kubelet"
Oct 31 00:28:42.987907 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.987867    2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:28:42.988079 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.987900    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:28:42.988172 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.988104    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:28:42.988844 ip-10-0-143-57 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:28:42.989433 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.989418    2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:28:42.990584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.990566    2580 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:28:42.993289 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:42.993273    2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 00:28:42.998289 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.998263    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:28:42.998887 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.998869    2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:28:42.999000 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:42.998980    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:42.999716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999577    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:28:42.999716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999582    2580 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:28:42.999716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999618    2580 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:28:42.999716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999684    2580 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:28:42.999716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999704    2580 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:28:42.999974 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999836    2580 factory.go:55] Registering systemd factory
Oct 31 00:28:42.999974 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:42.999849    2580 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:28:43.000028 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.000019    2580 factory.go:153] Registering CRI-O factory
Oct 31 00:28:43.000072 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.000029    2580 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:28:43.000127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.000078    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:28:43.000127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.000095    2580 factory.go:103] Registering Raw factory
Oct 31 00:28:43.000127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.000105    2580 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:28:43.001050 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.001037    2580 manager.go:319] Starting recovery of all containers
Oct 31 00:28:43.014381 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.014362    2580 manager.go:324] Recovery completed
Oct 31 00:28:43.018250 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.018141    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.020027 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020006    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.020113 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020043    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.020113 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020055    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.020585 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020572    2580 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:28:43.020585 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020580    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.020585 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020584    2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:28:43.020738 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.020618    2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:28:43.021285 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.021268    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.021357 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.021301    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.021357 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.021316    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.022133 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.022120    2580 policy_none.go:50] "Start"
Oct 31 00:28:43.022133 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.022136    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:28:43.022226 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.022146    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:28:43.023794 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.023783    2580 policy_none.go:44] "Start"
Oct 31 00:28:43.057259 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.057206    2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:28:43.060308 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060295    2580 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:28:43.060372 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.060324    2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:28:43.060372 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060333    2580 server.go:87] "Starting device plugin registration server"
Oct 31 00:28:43.060582 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060568    2580 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:28:43.060702 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060581    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:28:43.060702 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060667    2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:28:43.060802 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060761    2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:28:43.060802 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.060769    2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:28:43.061321 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.061300    2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:28:43.061402 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.061344    2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.134223 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.134182    2580 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-57.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 00:28:43.136210 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.134181    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-57.us-west-2.compute.internal.18e375bb148dad4b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-57.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-57.us-west-2.compute.internal,},FirstTimestamp:2026-10-31 00:28:42.987752779 +0000 UTC m=+0.398289396,LastTimestamp:2026-10-31 00:28:42.987752779 +0000 UTC m=+0.398289396,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-57.us-west-2.compute.internal,}"
Oct 31 00:28:43.168032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.161636    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.168032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.162646    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.168032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.162682    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.168032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.162698    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.168032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.162728    2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.179509 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.179485    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-57.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 00:28:43.186783 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.186754    2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-57.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 00:28:43.198202 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.198183    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:28:43.198277 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.198253    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-94cdx"
Oct 31 00:28:43.198837 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.198806    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:28:43.200093 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.200073    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:28:43.200093 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.200093    2580 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:28:43.200228 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.200109    2580 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:28:43.200228 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.200144    2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 00:28:43.300382 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.300351    2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"]
Oct 31 00:28:43.300554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.300417    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.301389 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.301364    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.301483 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.301399    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.301483 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.301410    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.303699 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.303686    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.303840 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.303817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.303886 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.303849    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.304458 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304445    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.304458 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304455    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.304677 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304477    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.304677 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304477    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.304677 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304493    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.304677 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.304500    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.306694 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.306675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.306803 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.306700    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:43.307399 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.307380    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:43.307469 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.307414    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:43.307469 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.307430    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:43.323967 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.323943    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.325936 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.325921    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.340000 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.339980    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:43.401208 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.401178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.401360 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.401216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.401360 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.401245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.435057 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.434989    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:43.437290 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.437271    2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:43.437899 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.437883    2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.437950 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.437908    2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-57.us-west-2.compute.internal\": node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.501920 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.501891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.502073 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.501921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.502073 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.501953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.502073 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.502004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.502073 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.502009    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.502073 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.502011    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.558471 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.558442    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.628371 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.628332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.630475 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.630455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:43.658684 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.658651    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.759067 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.759002    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.859388 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.859339    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:43.927744 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.927709    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 00:28:43.928274 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.927852    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:28:43.928274 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.927902    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:28:43.928274 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:43.927936    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:28:43.928274 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.927932    2580 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://abfbb1200564c4aa4933eb32a0e1d50d-bea5dad701e52471.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-143-57.us-west-2.compute.internal.18e375bb167a7a23\": read tcp 10.0.143.57:40928->77.112.219.56:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-143-57.us-west-2.compute.internal.18e375bb167a7a23  default   5288 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-57.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-57.us-west-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-57.us-west-2.compute.internal,},FirstTimestamp:2026-10-31 00:28:43 +0000 UTC,LastTimestamp:2026-10-31 00:28:43.162689442 +0000 UTC m=+0.573226063,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-57.us-west-2.compute.internal,}"
Oct 31 00:28:43.960129 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:43.960093    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.060999 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.060901    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.161470 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.161430    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.203378 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.203340    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:23:43 +0000 UTC" deadline="2028-06-30 02:10:52.508803752 +0000 UTC"
Oct 31 00:28:44.203378 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.203371    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14593h42m8.30543681s"
Oct 31 00:28:44.262023 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.261993    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.332700 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.332616    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:28:44.333740 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.333718    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:28:44.333874 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.333756    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:28:44.333874 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.333772    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:28:44.363082 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.363048    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.463461 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.463430    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.564130 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.564097    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.664830 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.664801    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.765445 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:44.765405    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:28:44.799919 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.799892    2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:44.883998 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:44.883966    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65a546c5c81725b0e0154a92190770e.slice/crio-cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf WatchSource:0}: Error finding container cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf: Status 404 returned error can't find the container with id cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf
Oct 31 00:28:44.884358 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:44.884341    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a29509a616f19d20041e78e9796eaef.slice/crio-522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d WatchSource:0}: Error finding container 522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d: Status 404 returned error can't find the container with id 522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d
Oct 31 00:28:44.890050 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.890032    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:28:44.899668 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.899649    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:44.972355 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.972284    2580 apiserver.go:52] "Watching apiserver"
Oct 31 00:28:44.974173 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.974158    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:28:44.975091 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.975078    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:28:44.999412 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:44.999391    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 00:28:45.131380 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.131345    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:28:45.131558 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.131425    2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:28:45.131834 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.131813    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2zp84","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal","openshift-network-diagnostics/network-check-target-lfth8","openshift-ovn-kubernetes/ovnkube-node-r8ml2","openshift-cluster-node-tuning-operator/tuned-8nwg8","openshift-image-registry/node-ca-j4sq6","openshift-network-operator/iptables-alerter-fwgw5","kube-system/global-pull-secret-syncer-tpc6d","openshift-dns/node-resolver-w9tkj","openshift-multus/multus-22sgf","openshift-multus/network-metrics-daemon-xltzg","kube-system/konnectivity-agent-g7bh6"]
Oct 31 00:28:45.135808 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.135787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.137952 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.137930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.140103 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.140084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:45.140204 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.140153    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:45.142354 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.142335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.144543 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.144523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.147132 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.147113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.150748 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.150725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.153066 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.153047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.153143 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.153125    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:45.155365 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.155220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.157804 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.157786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.160399 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.160381    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.160472 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.160435    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:45.162711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.162683    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"]
Oct 31 00:28:45.162784 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.162757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.182231 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.182210    2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:45.200365 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.200341    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:28:45.204239 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.204199    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerStarted","Data":"cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf"}
Oct 31 00:28:45.205213 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.205193    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"5a29509a616f19d20041e78e9796eaef","Type":"ContainerStarted","Data":"522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d"}
Oct 31 00:28:45.211436 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.211547 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.211547 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.211547 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.211547 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.211547 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.211820 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgclh\" (UniqueName: \"kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.212021 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.211973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxh5j\" (UniqueName: \"kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdz8\" (UniqueName: \"kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x58n4\" (UniqueName: \"kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.212254 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jxvr\" (UniqueName: \"kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxj7h\" (UniqueName: \"kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwjl\" (UniqueName: \"kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.212650 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.212997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213268 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfgdz\" (UniqueName: \"kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmvp\" (UniqueName: \"kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.213826 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.214246 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.214246 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.213468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.235483 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.235419    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:45.238580 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238559    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:28:45.238895 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238877    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bv698\""
Oct 31 00:28:45.238978 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238904    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6xpx\""
Oct 31 00:28:45.238978 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238932    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-klgwd\""
Oct 31 00:28:45.238978 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238935    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s5c24\""
Oct 31 00:28:45.238978 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.238937    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:28:45.239929 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.239912    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4l8km\""
Oct 31 00:28:45.240141 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240125    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.240476 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240454    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8m77\""
Oct 31 00:28:45.240559 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240500    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.240559 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240487    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-5b488\""
Oct 31 00:28:45.240559 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240551    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.240734 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240556    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.240789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240733    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.240789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240758    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:28:45.240789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240771    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.240925 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240881    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.240925 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240899    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzctz\""
Oct 31 00:28:45.240998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240928    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.240998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.240937    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.243725 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.243705    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.243725 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.243719    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:28:45.286575 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.286545    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:28:45.286575 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.286566    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.286575 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.286569    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:28:45.286804 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.286551    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:28:45.286804 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.286620    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:28:45.287673 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287658    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.287715 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287656    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:28:45.287715 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287693    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:28:45.287778 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287716    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:28:45.287809 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287784    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:28:45.287809 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287796    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:28:45.287879 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.287811    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:28:45.289943 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.289930    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-2sfqr\""
Oct 31 00:28:45.290060 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.290049    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:28:45.296427 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.296412    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:28:45.296490 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.296449    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jldv"
Oct 31 00:28:45.313785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.313785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313988    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.314005 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314005    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgclh\" (UniqueName: \"kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313978    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314052    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314077    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxh5j\" (UniqueName: \"kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.313930    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdz8\" (UniqueName: \"kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314265    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.314342 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314385    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58n4\" (UniqueName: \"kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314426    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314468    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jxvr\" (UniqueName: \"kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314620    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxj7h\" (UniqueName: \"kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314637    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314642    2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314686    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.315152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314884    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314944    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314963    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.314981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315021    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwjl\" (UniqueName: \"kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316009 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315300    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315348    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315354    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315427    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315521    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.316891 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315557    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315655    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315673    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315248    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315724    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315889    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315909    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.315924    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgdz\" (UniqueName: \"kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316000    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.317736 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.316016    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:45.815996756 +0000 UTC m=+3.226533380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.315950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316107    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316368    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmvp\" (UniqueName: \"kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.318416 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316977    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317096    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.316899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317133    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317167    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317187    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317215    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.317227    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317240    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.318916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317246    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317278    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.317284    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:45.817268922 +0000 UTC m=+3.227805531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317339    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317343    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317345    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317394    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317426    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317428    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317445    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317487    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317516    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317595    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.319393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317640    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317659    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.317849    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.318345    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.318623    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.318756    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.319861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.319400    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.383360 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.383095    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:28:45.383360 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.383124    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:28:45.383360 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.383138    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:45.383360 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.383216    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:45.883194281 +0000 UTC m=+3.293730903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:45.386015 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.385983    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgdz\" (UniqueName: \"kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.386286 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.385983    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgclh\" (UniqueName: \"kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.386414 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdz8\" (UniqueName: \"kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.386514 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386414    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxh5j\" (UniqueName: \"kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.386514 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386417    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxj7h\" (UniqueName: \"kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.386514 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386486    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmvp\" (UniqueName: \"kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.386791 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386768    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jxvr\" (UniqueName: \"kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.386973 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.386955    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58n4\" (UniqueName: \"kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.387724 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.387706    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwjl\" (UniqueName: \"kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.427411 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.427386    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:28:45.446725 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.446690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:28:45.457629 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.457584    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751d219a_41af_4a6e_9eaf_25879c685574.slice/crio-ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e WatchSource:0}: Error finding container ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e: Status 404 returned error can't find the container with id ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e
Oct 31 00:28:45.458813 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.458791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:28:45.466962 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.466941    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0e5c6c_6f68_4d3b_a07c_a7f5e6f9025e.slice/crio-1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4 WatchSource:0}: Error finding container 1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4: Status 404 returned error can't find the container with id 1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4
Oct 31 00:28:45.474464 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.474448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:28:45.482970 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.482948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:28:45.483271 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.483248    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e919594_7e7d_413f_a997_80a2b9780006.slice/crio-3c8f82e99206dbde4c7d29fba43867848d1aa6e946e4c9f39c831523224afd70 WatchSource:0}: Error finding container 3c8f82e99206dbde4c7d29fba43867848d1aa6e946e4c9f39c831523224afd70: Status 404 returned error can't find the container with id 3c8f82e99206dbde4c7d29fba43867848d1aa6e946e4c9f39c831523224afd70
Oct 31 00:28:45.486846 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.486829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:28:45.488897 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.488880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:28:45.490756 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.490734    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8186db_5274_46ad_942c_6aca4b1d1686.slice/crio-68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1 WatchSource:0}: Error finding container 68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1: Status 404 returned error can't find the container with id 68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1
Oct 31 00:28:45.495019 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.495002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22sgf"
Oct 31 00:28:45.496516 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.496498    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03241bf1_5cee_42ff_90cf_d3ae59a39fae.slice/crio-7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b WatchSource:0}: Error finding container 7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b: Status 404 returned error can't find the container with id 7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b
Oct 31 00:28:45.497375 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.497356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:45.498340 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.498312    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7c0204_7117_4e6e_b910_953890e7d582.slice/crio-ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b WatchSource:0}: Error finding container ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b: Status 404 returned error can't find the container with id ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b
Oct 31 00:28:45.501300 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.501284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:28:45.505022 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.504998    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da59575_dc74_4cda_9e57_b9437c54dbd7.slice/crio-a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9 WatchSource:0}: Error finding container a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9: Status 404 returned error can't find the container with id a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9
Oct 31 00:28:45.509629 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.509574    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc3eead_3ad0_46f2_b545_ec15921a2ab5.slice/crio-0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb WatchSource:0}: Error finding container 0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb: Status 404 returned error can't find the container with id 0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb
Oct 31 00:28:45.510144 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:28:45.510124    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f325f0_14b6_4849_9db1_1def3092575f.slice/crio-be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4 WatchSource:0}: Error finding container be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4: Status 404 returned error can't find the container with id be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4
Oct 31 00:28:45.821635 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.821523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:45.821635 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.821576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:45.821853 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.821701    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:45.821853 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.821709    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:45.821853 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.821756    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:46.821743693 +0000 UTC m=+4.232280311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:45.821853 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.821776    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:46.821766985 +0000 UTC m=+4.232303590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:45.922890 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:45.922854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:45.923050 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.923008    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:28:45.923050 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.923029    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:28:45.923050 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.923039    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:45.923162 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:45.923091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:46.923076247 +0000 UTC m=+4.333612855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:46.210367 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.210301    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22sgf" event={"ID":"5da59575-dc74-4cda-9e57-b9437c54dbd7","Type":"ContainerStarted","Data":"a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9"}
Oct 31 00:28:46.211775 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.211745    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9tkj" event={"ID":"3a7c0204-7117-4e6e-b910-953890e7d582","Type":"ContainerStarted","Data":"ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b"}
Oct 31 00:28:46.213057 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.213025    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b"}
Oct 31 00:28:46.214303 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.214278    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nwg8" event={"ID":"6e919594-7e7d-413f-a997-80a2b9780006","Type":"ContainerStarted","Data":"3c8f82e99206dbde4c7d29fba43867848d1aa6e946e4c9f39c831523224afd70"}
Oct 31 00:28:46.215801 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.215776    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7bh6" event={"ID":"cdc3eead-3ad0-46f2-b545-ec15921a2ab5","Type":"ContainerStarted","Data":"0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb"}
Oct 31 00:28:46.217044 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.217019    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwgw5" event={"ID":"7f8186db-5274-46ad-942c-6aca4b1d1686","Type":"ContainerStarted","Data":"68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1"}
Oct 31 00:28:46.218290 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.218270    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm" event={"ID":"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e","Type":"ContainerStarted","Data":"1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4"}
Oct 31 00:28:46.219464 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.219440    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4sq6" event={"ID":"751d219a-41af-4a6e-9eaf-25879c685574","Type":"ContainerStarted","Data":"ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e"}
Oct 31 00:28:46.220565 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.220546    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerStarted","Data":"be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4"}
Oct 31 00:28:46.299294 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.299231    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:23:45 +0000 UTC" deadline="2028-04-07 13:23:42.802091562 +0000 UTC"
Oct 31 00:28:46.299294 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.299286    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12588h54m56.502809649s"
Oct 31 00:28:46.830485 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.830406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:46.830485 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.830468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:46.830710 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.830580    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:46.830710 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.830660    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:48.830643698 +0000 UTC m=+6.241180319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:46.830816 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.830723    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:46.830816 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.830757    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:48.830746773 +0000 UTC m=+6.241283382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:46.931332 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:46.931291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:46.931520 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.931506    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:28:46.931585 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.931524    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:28:46.931585 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.931539    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:46.931729 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:46.931619    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:48.931581273 +0000 UTC m=+6.342117895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:47.203156 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:47.203125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:47.203341 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:47.203259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:47.203407 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:47.203341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:47.203456 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:47.203407    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:47.203507 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:47.203462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:47.203563 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:47.203535    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:47.300184 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:47.300140    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:23:45 +0000 UTC" deadline="2028-04-26 23:49:18.37256495 +0000 UTC"
Oct 31 00:28:47.300184 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:47.300183    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13055h20m31.072386566s"
Oct 31 00:28:48.851129 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:48.850940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:48.851534 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:48.851161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:48.851534 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.851249    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:48.851534 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.851291    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:52.851279548 +0000 UTC m=+10.261816166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:48.851534 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.851332    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:48.851534 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.851355    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:52.851345677 +0000 UTC m=+10.261882296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:48.952619 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:48.952243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:48.952619 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.952452    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:28:48.952619 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.952473    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:28:48.952619 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.952495    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:48.952619 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:48.952554    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:28:52.952535328 +0000 UTC m=+10.363071952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:49.206173 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:49.205767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:49.206173 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:49.205928    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:49.206173 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:49.206021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:49.206173 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:49.206122    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:49.210721 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:49.206540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:49.210721 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:49.206923    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:49.264982 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:49.264908    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerStarted","Data":"09f319b523ddcf98568d5aa128d04b1303fec19bee5519058c15b36e624b0f49"}
Oct 31 00:28:49.267533 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:49.267115    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerStarted","Data":"6740fb42b3fb36e8f60947e900a03b9aeaf587f45201bc5e799a17b0089d7cc9"}
Oct 31 00:28:50.272415 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.271686    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"5a29509a616f19d20041e78e9796eaef","Type":"ContainerStarted","Data":"a3c851f3bcb7f71c9fe4a56cbd5c658a372eba7515dacd1ce6a78614938380b2"}
Oct 31 00:28:50.285933 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.285051    2580 generic.go:356] "Generic (PLEG): container finished" podID="f65a546c5c81725b0e0154a92190770e" containerID="09f319b523ddcf98568d5aa128d04b1303fec19bee5519058c15b36e624b0f49" exitCode=0
Oct 31 00:28:50.285933 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.285845    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerDied","Data":"09f319b523ddcf98568d5aa128d04b1303fec19bee5519058c15b36e624b0f49"}
Oct 31 00:28:50.295640 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.295612    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="6740fb42b3fb36e8f60947e900a03b9aeaf587f45201bc5e799a17b0089d7cc9" exitCode=0
Oct 31 00:28:50.295768 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.295657    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"6740fb42b3fb36e8f60947e900a03b9aeaf587f45201bc5e799a17b0089d7cc9"}
Oct 31 00:28:50.389716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:50.389643    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal" podStartSLOduration=5.389623625 podStartE2EDuration="5.389623625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:50.389360214 +0000 UTC m=+7.799896841" watchObservedRunningTime="2026-10-31 00:28:50.389623625 +0000 UTC m=+7.800160253"
Oct 31 00:28:51.202785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.202754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:51.202948 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.202753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:51.203021 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:51.202908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:51.203084 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.203040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:51.203133 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:51.203036    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:51.203185 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:51.203126    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:51.300259 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.300221    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7bh6" event={"ID":"cdc3eead-3ad0-46f2-b545-ec15921a2ab5","Type":"ContainerStarted","Data":"3250ae0a04c34f3fc857f9a7f9881ace6c55bfa50e15c50855d5ddc3d47f3350"}
Oct 31 00:28:51.307226 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.306983    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerStarted","Data":"2ed579aa209bce48c3d3fa60d23f9c5ce9568ab96deb7b164571afe7b05d6895"}
Oct 31 00:28:51.425627 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.423062    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g7bh6" podStartSLOduration=3.2738370359999998 podStartE2EDuration="8.423041362s" totalImagesPullingTime="5.149204326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:51.422266245 +0000 UTC m=+8.832802876" watchObservedRunningTime="2026-10-31 00:28:51.423041362 +0000 UTC m=+8.833577991"
Oct 31 00:28:51.542761 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.542694    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" podStartSLOduration=7.542672288 podStartE2EDuration="7.542672288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:51.541557856 +0000 UTC m=+8.952094483" watchObservedRunningTime="2026-10-31 00:28:51.542672288 +0000 UTC m=+8.953208916"
Oct 31 00:28:51.605785 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.605733    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:51.834920 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:51.834778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:52.319690 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.319657    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4sq6" event={"ID":"751d219a-41af-4a6e-9eaf-25879c685574","Type":"ContainerStarted","Data":"a6777cae98494b85744f6554d8bff22ee3e62bef5018fe81517543d0182baf9f"}
Oct 31 00:28:52.451321 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.451277    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j4sq6" podStartSLOduration=3.568085187 podStartE2EDuration="9.451259093s" totalImagesPullingTime="5.883173906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:52.450847517 +0000 UTC m=+9.861384145" watchObservedRunningTime="2026-10-31 00:28:52.451259093 +0000 UTC m=+9.861795720"
Oct 31 00:28:52.636253 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.636134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:52.889712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.889632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:52.889712 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.889709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:52.889970 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.889881    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:52.889970 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.889932    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:00.88991571 +0000 UTC m=+18.300452316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:28:52.890276 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.890259    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:52.890387 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.890306    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:00.890294736 +0000 UTC m=+18.300831354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:28:52.960837 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.960276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:52.990209 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:52.990178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:52.990407 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.990377    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:28:52.990407 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.990397    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:28:52.990407 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.990410    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:52.990644 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:52.990466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:00.990448889 +0000 UTC m=+18.400985515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:28:53.183286 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.183245    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:53.201771 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.201743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:53.201922 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:53.201819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:53.202080 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.202057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:53.202219 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:53.202196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:53.202356 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.202270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:53.202356 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:53.202341    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:53.325129 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.325093    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm" event={"ID":"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e","Type":"ContainerStarted","Data":"0d1c47e742dacf56f4f0297dbd2c598fa2770c0b539fe3dbf5e6c98b56ab42ef"}
Oct 31 00:28:53.369105 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.369071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:53.752928 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.752847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:53.784544 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.783960    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:53.784732 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:53.784714    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:28:54.334734 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:54.334653    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22sgf" event={"ID":"5da59575-dc74-4cda-9e57-b9437c54dbd7","Type":"ContainerStarted","Data":"962aea953f8ba9303bb52a0a1e53e08626333599f7dd686d400dcb43304bb05f"}
Oct 31 00:28:54.564627 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:54.563409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:54.649032 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:54.648898    2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:28:54.964789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:54.960592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:55.065937 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.065825    2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:28:54.64892078Z","UUID":"d61a57c8-c1cd-4e4c-ac53-c737c2812f1c","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:28:55.067586 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.067569    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:28:55.067699 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.067593    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:28:55.163353 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.160520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:55.200477 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.200437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:55.200580 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:55.200565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:55.200817 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.200790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:55.200930 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:55.200903    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:55.201041 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.201027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:55.201200 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:55.201180    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:55.338443 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.338405    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9tkj" event={"ID":"3a7c0204-7117-4e6e-b910-953890e7d582","Type":"ContainerStarted","Data":"0cdce755de286c241d72c7a88ebc09714e637f5db745d18b144e35a099882b87"}
Oct 31 00:28:55.340651 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.340628    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm" event={"ID":"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e","Type":"ContainerStarted","Data":"5ea762ad47f669d7cdd9c84027b99bc084f66789150941ea29ef043af869f9a7"}
Oct 31 00:28:55.342726 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.342698    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="a2c8140daee7394930f90a267dd61432422e47c61e4d7b3d9b87ad9442518ec2" exitCode=0
Oct 31 00:28:55.343241 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.343222    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"a2c8140daee7394930f90a267dd61432422e47c61e4d7b3d9b87ad9442518ec2"}
Oct 31 00:28:55.359306 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.359281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:55.457419 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.457272    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-22sgf" podStartSLOduration=3.824756817 podStartE2EDuration="12.457250881s" totalImagesPullingTime="8.632494064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:54.457662526 +0000 UTC m=+11.868199152" watchObservedRunningTime="2026-10-31 00:28:55.457250881 +0000 UTC m=+12.867787509"
Oct 31 00:28:55.458613 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.458549    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-w9tkj" podStartSLOduration=3.705740288 podStartE2EDuration="12.458537571s" totalImagesPullingTime="8.752797283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:55.457203966 +0000 UTC m=+12.867740595" watchObservedRunningTime="2026-10-31 00:28:55.458537571 +0000 UTC m=+12.869074198"
Oct 31 00:28:55.761045 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:55.761010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:56.351981 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:56.351952    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwgw5" event={"ID":"7f8186db-5274-46ad-942c-6aca4b1d1686","Type":"ContainerStarted","Data":"8ca4599da3281f3e42392cadc1b8546fdeb712a38d5d914c65ed665030e53360"}
Oct 31 00:28:56.358163 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:56.358134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:56.955325 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:56.955246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:57.164754 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.164722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:57.200887 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.200855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:57.201056 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.200865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:57.201056 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:57.200977    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:57.201056 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.200998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:57.201219 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:57.201090    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:57.201219 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:57.201173    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:57.355724 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.355644    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm" event={"ID":"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e","Type":"ContainerStarted","Data":"dab2d9517a8583f6fc0a5335ed4349efebd857e6a505329873d4670876cf1e65"}
Oct 31 00:28:57.356346 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.356312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:57.358406 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.358381    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="b4c156aa8bf8cc93f1b45925868e6c7c58bfc7f491aa0a4d0bc6f4c822e3df69" exitCode=0
Oct 31 00:28:57.358524 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.358435    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"b4c156aa8bf8cc93f1b45925868e6c7c58bfc7f491aa0a4d0bc6f4c822e3df69"}
Oct 31 00:28:57.360192 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.360167    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nwg8" event={"ID":"6e919594-7e7d-413f-a997-80a2b9780006","Type":"ContainerStarted","Data":"5427abfd05320e9c17deb0a3076b4881ebf5bbd3fa3dcf6c8531851c45a29195"}
Oct 31 00:28:57.478581 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.478098    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwgw5" podStartSLOduration=5.924578389 podStartE2EDuration="14.4780848s" totalImagesPullingTime="8.553506411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:56.473372887 +0000 UTC m=+13.883909504" watchObservedRunningTime="2026-10-31 00:28:57.4780848 +0000 UTC m=+14.888621427"
Oct 31 00:28:57.478581 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.478431    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm" podStartSLOduration=3.986518068 podStartE2EDuration="14.478422495s" totalImagesPullingTime="10.491904427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:57.477769932 +0000 UTC m=+14.888306559" watchObservedRunningTime="2026-10-31 00:28:57.478422495 +0000 UTC m=+14.888959122"
Oct 31 00:28:57.542470 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.542437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:57.599380 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.599325    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8nwg8" podStartSLOduration=3.807204476 podStartE2EDuration="14.599312141s" totalImagesPullingTime="10.792107665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:28:57.598886968 +0000 UTC m=+15.009423595" watchObservedRunningTime="2026-10-31 00:28:57.599312141 +0000 UTC m=+15.009848768"
Oct 31 00:28:57.728988 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.728950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:57.917501 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:57.917459    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:58.374344 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:58.374127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:58.568459 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:58.568430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:58.795552 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:58.795524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:59.161998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.161961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.201035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.201071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.201034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:59.201161    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:59.201241    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:28:59.201462 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:28:59.201311    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:28:59.367455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.367421    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="2fe5f2eb32d4c1a36964228905eda50d2d96f240aa6cd568055dec650696211a" exitCode=0
Oct 31 00:28:59.367647 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.367467    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"2fe5f2eb32d4c1a36964228905eda50d2d96f240aa6cd568055dec650696211a"}
Oct 31 00:28:59.369830 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.369804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:59.559800 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.559715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:28:59.944579 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:28:59.944547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:00.953255 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:00.953028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:00.953614 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:00.953301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:00.953614 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:00.953171    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:29:00.953614 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:00.953399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:16.953375276 +0000 UTC m=+34.363911885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:29:00.953614 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:00.953406    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:29:00.953614 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:00.953455    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs podName:1927717c-0969-4669-85cf-da2c7d741f42 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:16.953440715 +0000 UTC m=+34.363977322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs") pod "network-metrics-daemon-xltzg" (UID: "1927717c-0969-4669-85cf-da2c7d741f42") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:29:01.054372 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.054279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:01.054566 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.054447    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:29:01.054566 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.054472    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:29:01.054566 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.054486    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:29:01.054566 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.054545    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:17.054531579 +0000 UTC m=+34.465068183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:29:01.201154 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.201126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:01.201343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.201195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:01.201343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.201196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:01.201343 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.201305    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:01.201572 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.201403    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:01.201572 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:01.201489    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:01.374849 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.374763    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"ca6922d5736d46b4811da289ccbcc123f364a548f9628f2116fcd85a3b89e5a7"}
Oct 31 00:29:01.374998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.374857    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"3a129293124c9cee6d56e2b03a538d45fd687168b0bdfc72efa8682a02bcd787"}
Oct 31 00:29:01.374998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.374905    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"a8cb87e149dbed68d985cbe620f5573ba5c847d175dff9414df6ac68e37435de"}
Oct 31 00:29:01.374998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.374950    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"c10e1ca461aaa12aba95f78338b0170b5278620445def58a4a9e4dffaaf2ed1a"}
Oct 31 00:29:01.374998 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.374995    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"da9a3cc1c9b9c6293a16f6c6566c79787bba14bbf55e0c68bc25feaa1d2485a0"}
Oct 31 00:29:01.375164 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:01.375040    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"4f5fea927a4ec2887fb12bf8195680d49dcc51fb1a63a49e68fd5e3983212a46"}
Oct 31 00:29:02.337996 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.337961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:02.378962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.378927    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="c2874ece11c2751f4a129307c4f2ebea809649dcf4be4642662cdc4343276c67" exitCode=0
Oct 31 00:29:02.379139 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.378982    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"c2874ece11c2751f4a129307c4f2ebea809649dcf4be4642662cdc4343276c67"}
Oct 31 00:29:02.528586 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.528545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:02.715479 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.715435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:02.905463 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:02.905431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:03.201923 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.201888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:03.202072 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.201971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:03.202072 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.202016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:03.202072 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:03.202019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:03.202235 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:03.202102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:03.202235 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:03.202172    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:03.254385 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.254349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:03.384307 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.384219    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="e78d189b82f46e7c55a2766431095b7cbff71b1c768455c506e55a6ff3ea5473" exitCode=0
Oct 31 00:29:03.384792 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.384307    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerDied","Data":"e78d189b82f46e7c55a2766431095b7cbff71b1c768455c506e55a6ff3ea5473"}
Oct 31 00:29:03.387724 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.387702    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"dd6079f682650dbc4d2588ddf99494836e90741d75e97e42e6e70b3e42cdabc9"}
Oct 31 00:29:03.888350 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.888324    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:03.888498 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.888437    2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:29:03.888964 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:03.888938    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:04.392459 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:04.392425    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zp84" event={"ID":"a2f325f0-14b6-4849-9db1-1def3092575f","Type":"ContainerStarted","Data":"da9c5ee9321d6a96adf5bbaf258e81650c0bd6909a1c18e89fdd25ec074ab3dc"}
Oct 31 00:29:04.569211 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:04.569166    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2zp84" podStartSLOduration=8.714377701 podStartE2EDuration="21.569153766s" totalImagesPullingTime="12.854776065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:04.56890252 +0000 UTC m=+21.979439148" watchObservedRunningTime="2026-10-31 00:29:04.569153766 +0000 UTC m=+21.979690393"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:05.200989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:05.200997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:05.201223    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:05.201003    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:05.201453    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:05.204223 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:05.201687    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:05.398492 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:05.398237    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" event={"ID":"03241bf1-5cee-42ff-90cf-d3ae59a39fae","Type":"ContainerStarted","Data":"109575474b98f5a7328b3f7944e202e50d5fcc977e6fc7a90ce566a680ecfde6"}
Oct 31 00:29:05.616855 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:05.616809    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2" podStartSLOduration=7.639237627 podStartE2EDuration="22.616795977s" totalImagesPullingTime="14.97755835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:05.590349659 +0000 UTC m=+23.000886290" watchObservedRunningTime="2026-10-31 00:29:05.616795977 +0000 UTC m=+23.027332604"
Oct 31 00:29:06.400296 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:06.400270    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:06.400805 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:06.400344    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:06.400805 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:06.400390    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:06.416435 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:06.416412    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:06.416567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:06.416503    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:07.200806 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:07.200775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:07.200806 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:07.200797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:07.201040 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:07.200804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:07.201040 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:07.200896    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:07.201040 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:07.200968    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:07.201181 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:07.201056    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:07.683467 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:07.683433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:07.885024 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:07.884993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:08.234874 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:08.234841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:08.426789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:08.426759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:09.201410 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.201376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:09.201410 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.201397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:09.201978 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.201497    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:09.201978 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.201542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:09.201978 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.201658    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:09.201978 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.201722    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:09.879999 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.879795    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:09.952744 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.952716    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpc6d"]
Oct 31 00:29:09.952867 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.952822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:09.952932 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.952912    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:09.955100 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.955078    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfth8"]
Oct 31 00:29:09.955211 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.955176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:09.955299 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.955279    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:09.955572 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.955554    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xltzg"]
Oct 31 00:29:09.955659 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:09.955647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:09.955740 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:09.955726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:10.117055 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:10.117020    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:10.427594 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:10.427555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:10.641204 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:10.641171    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:10.821411 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:10.821343    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9tkj_3a7c0204-7117-4e6e-b910-953890e7d582/dns-node-resolver/0.log"
Oct 31 00:29:10.917893 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:10.917856    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:11.140908 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:11.140841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:11.200887 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:11.200859    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:11.201034 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:11.200867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:11.201034 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:11.200958    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:11.201117 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:11.201031    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:11.270578 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:11.270559    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9tkj_3a7c0204-7117-4e6e-b910-953890e7d582/dns-node-resolver/0.log"
Oct 31 00:29:11.821861 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:11.821833    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4sq6_751d219a-41af-4a6e-9eaf-25879c685574/node-ca/0.log"
Oct 31 00:29:12.114265 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:12.114182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:12.201147 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:12.201121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:12.201304 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:12.201231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:12.269830 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:12.269805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4sq6_751d219a-41af-4a6e-9eaf-25879c685574/node-ca/0.log"
Oct 31 00:29:12.304652 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:12.304613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:13.136875 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:13.136803    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:13.201700 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:13.201665    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:13.201843 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:13.201787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:13.201916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:13.201850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:13.202012 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:13.201992    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:13.394271 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:13.394192    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:14.201413 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:14.201241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:14.201814 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:14.201491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xltzg" podUID="1927717c-0969-4669-85cf-da2c7d741f42"
Oct 31 00:29:14.782923 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:14.782882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:14.969878 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:14.969839    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:15.191275 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.191246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:15.201149 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.201133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:15.201242 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:15.201226    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpc6d" podUID="8c7eb1ae-0643-472e-a33c-4c7c3b88a266"
Oct 31 00:29:15.201303 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.201287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:15.201382 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:15.201366    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfth8" podUID="a21b4377-105b-4b2f-a7a5-d93dc6f9be39"
Oct 31 00:29:15.375532 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.375504    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeReady"
Oct 31 00:29:15.375877 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.375633    2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 00:29:15.390924 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.390894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:15.545892 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.545816    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hz4np"]
Oct 31 00:29:15.567852 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.567817    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mmb5b"]
Oct 31 00:29:15.568002 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.567961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.579447 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.579425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:15.583693 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.583677    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dggrt"]
Oct 31 00:29:15.583796 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.583782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.596287 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.596268    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz4np"]
Oct 31 00:29:15.596369 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.596301    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mmb5b"]
Oct 31 00:29:15.596369 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.596319    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"]
Oct 31 00:29:15.596441 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.596370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.610405 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.610387    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dggrt"]
Oct 31 00:29:15.610486 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.610474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.617471 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.617451    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"]
Oct 31 00:29:15.622806 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.622786    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vb9k\""
Oct 31 00:29:15.622907 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.622874    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:29:15.622992 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.622978    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:29:15.661219 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.661196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.661303 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.661232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.661341 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.661325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg6t\" (UniqueName: \"kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.661382 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.661369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.723346 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723327    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:29:15.723566 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723548    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:29:15.723657 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723573    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 00:29:15.723730 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723717    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:29:15.723841 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723809    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:29:15.723972 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723819    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:29:15.723972 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723968    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:29:15.724078 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723974    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzhm5\""
Oct 31 00:29:15.724078 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723936    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:29:15.724078 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723828    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 00:29:15.724078 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723923    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:29:15.724078 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.723982    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-bpzsc\""
Oct 31 00:29:15.737183 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.737168    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cbfrg\""
Oct 31 00:29:15.737256 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.737202    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:29:15.737256 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.737233    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 00:29:15.761537 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:15.761659 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.761723 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.761723 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.761834 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.761834 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw7g\" (UniqueName: \"kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.761927 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.761927 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.762029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.762029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.762029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.761982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.762156 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqcb\" (UniqueName: \"kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.762156 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762078    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.762156 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.762156 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pq6m\" (UniqueName: \"kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.762292 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.762292 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg6t\" (UniqueName: \"kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.762455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.762439    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.765667 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.765652    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.826705 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.826650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg6t\" (UniqueName: \"kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.863500 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw7g\" (UniqueName: \"kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.863635 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.863635 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.863751 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.863751 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.863751 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqcb\" (UniqueName: \"kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.863751 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.863949 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pq6m\" (UniqueName: \"kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.863949 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.863949 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.863949 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.863897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.864185 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.864162    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.864253 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.864235    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.864373 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.864350    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.864843 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.864820    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.866091 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.866067    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.866311 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.866294    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.866662 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.866644    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.866730 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.866682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.902703 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.902683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:15.929965 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.929938    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw7g\" (UniqueName: \"kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:15.930146 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.930124    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pq6m\" (UniqueName: \"kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:15.930399 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.930379    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqcb\" (UniqueName: \"kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:15.982722 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:15.982696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:16.001464 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.001439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:16.200961 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.200932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:16.211754 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.211729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:16.221512 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.221492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:16.256432 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.256414    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:29:16.256539 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.256454    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prxzz\""
Oct 31 00:29:16.295622 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.288048    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:29:16.303796 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.303777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.349814 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.349752    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:29:16.353469 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.353449    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz4np"]
Oct 31 00:29:16.356705 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:16.356676    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198c39d2_beca_4447_abeb_3b57050cb3f6.slice/crio-ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d WatchSource:0}: Error finding container ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d: Status 404 returned error can't find the container with id ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d
Oct 31 00:29:16.359127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359084    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 31 00:29:16.359127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359117    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 31 00:29:16.359127 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359123    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 31 00:29:16.359343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359125    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tcw2z\""
Oct 31 00:29:16.359343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359151    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 31 00:29:16.359343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359084    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 31 00:29:16.359343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359219    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 31 00:29:16.359343 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.359227    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 31 00:29:16.406702 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:16.406661    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafad05c_abe0_4a45_a8f4_b3ffb5aaf055.slice/crio-5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e WatchSource:0}: Error finding container 5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e: Status 404 returned error can't find the container with id 5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e
Oct 31 00:29:16.408940 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.408806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:16.409659 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.409641    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 31 00:29:16.410795 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.410773    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"]
Oct 31 00:29:16.424818 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.424793    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz4np" event={"ID":"198c39d2-beca-4447-abeb-3b57050cb3f6","Type":"ContainerStarted","Data":"ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d"}
Oct 31 00:29:16.425902 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.425879    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4" event={"ID":"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055","Type":"ContainerStarted","Data":"5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e"}
Oct 31 00:29:16.455043 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.454914    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dggrt"]
Oct 31 00:29:16.458452 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:16.458432    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f3537e_25dc_4592_83c7_795b5f1d8af0.slice/crio-01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998 WatchSource:0}: Error finding container 01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998: Status 404 returned error can't find the container with id 01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998
Oct 31 00:29:16.468502 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468577 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468577 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468672 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468768 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468847 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468938 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.468983 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.468947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570015 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.569982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570193 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570193 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570310 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570310 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570310 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570454 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570454 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.570901 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.570569    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.571120 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.571046    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.571212 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.571128    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.571304 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.571283    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.571838 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.571820    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.572711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.572692    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.572882 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.572867    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.590781 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.590755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:16.604538 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.604482    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mmb5b"]
Oct 31 00:29:16.607662 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:16.607641    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bc206e_b599_4c37_bb62_9c2d7047a85d.slice/crio-afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675 WatchSource:0}: Error finding container afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675: Status 404 returned error can't find the container with id afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675
Oct 31 00:29:16.636238 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.636218    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.920549 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.920517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:16.973711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.973681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:16.973833 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.973751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:16.974923 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:16.974235    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:29:16.974923 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:16.974310    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret podName:8c7eb1ae-0643-472e-a33c-4c7c3b88a266 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:48.97429036 +0000 UTC m=+66.384826965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret") pod "global-pull-secret-syncer-tpc6d" (UID: "8c7eb1ae-0643-472e-a33c-4c7c3b88a266") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:29:16.976291 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:16.976252    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:17.074698 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.074669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:17.074866 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:17.074814    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:29:17.074866 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:17.074830    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:29:17.074866 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:17.074841    2580 projected.go:196] Error preparing data for projected volume kube-api-access-7qv86 for pod openshift-network-diagnostics/network-check-target-lfth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:29:17.074958 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:17.074896    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86 podName:a21b4377-105b-4b2f-a7a5-d93dc6f9be39 nodeName:}" failed. No retries permitted until 2026-10-31 00:29:49.074879025 +0000 UTC m=+66.485415630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qv86" (UniqueName: "kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86") pod "network-check-target-lfth8" (UID: "a21b4377-105b-4b2f-a7a5-d93dc6f9be39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:29:17.154082 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.154039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:17.202159 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.202135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:17.202583 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.202561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:17.257515 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.257482    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:29:17.257515 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.257482    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:29:17.258787 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.258763    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9b4md\""
Oct 31 00:29:17.258787 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.258780    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6z87r\""
Oct 31 00:29:17.258930 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.258791    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:29:17.300309 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.300290    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:29:17.305050 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:17.303474    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf81ff8e_3a14_417d_9bd9_705389fb906b.slice/crio-baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986 WatchSource:0}: Error finding container baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986: Status 404 returned error can't find the container with id baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986
Oct 31 00:29:17.429320 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.429285    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b57f57c9-zpb6f" event={"ID":"af81ff8e-3a14-417d-9bd9-705389fb906b","Type":"ContainerStarted","Data":"baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986"}
Oct 31 00:29:17.430480 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.430452    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mmb5b" event={"ID":"72bc206e-b599-4c37-bb62-9c2d7047a85d","Type":"ContainerStarted","Data":"afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675"}
Oct 31 00:29:17.431896 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.431877    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dggrt" event={"ID":"f8f3537e-25dc-4592-83c7-795b5f1d8af0","Type":"ContainerStarted","Data":"7e8f2c7b4748b239a32bbe4f6a4c15b7f27e10de9f01c92675c8814ca0f811a4"}
Oct 31 00:29:17.431979 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.431918    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dggrt" event={"ID":"f8f3537e-25dc-4592-83c7-795b5f1d8af0","Type":"ContainerStarted","Data":"01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998"}
Oct 31 00:29:17.524990 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.524921    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xltzg"]
Oct 31 00:29:17.528141 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:17.528096    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1927717c_0969_4669_85cf_da2c7d741f42.slice/crio-c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0 WatchSource:0}: Error finding container c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0: Status 404 returned error can't find the container with id c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0
Oct 31 00:29:17.617365 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.617328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:17.801761 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:17.801650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:18.437989 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:18.437893    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xltzg" event={"ID":"1927717c-0969-4669-85cf-da2c7d741f42","Type":"ContainerStarted","Data":"c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0"}
Oct 31 00:29:18.440589 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:18.440468    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dggrt" event={"ID":"f8f3537e-25dc-4592-83c7-795b5f1d8af0","Type":"ContainerStarted","Data":"7a97aed181e3bdcb54b39cbd2d6901511e5afd15a3722de0dcbdbbc87618df53"}
Oct 31 00:29:19.455835 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:19.455731    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz4np" event={"ID":"198c39d2-beca-4447-abeb-3b57050cb3f6","Type":"ContainerStarted","Data":"bcd4a8ff6e742d9cbfd3ca3b8d28c0a88f97e1f6c02a09a108dbb13fca32073d"}
Oct 31 00:29:19.460660 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:19.460067    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4" event={"ID":"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055","Type":"ContainerStarted","Data":"19a63fcfa490145d39adea7c381d7cde6fa775ff081f915e29540c5a387ecf6c"}
Oct 31 00:29:19.460660 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:19.460123    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4" event={"ID":"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055","Type":"ContainerStarted","Data":"0441cf5308fffbcdcfd66addd55ebcc191923010d6912a19114698b40f7fe543"}
Oct 31 00:29:19.585117 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:19.584269    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4" podStartSLOduration=2.586520754 podStartE2EDuration="4.584249338s" totalImagesPullingTime="1.997728584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:19.583766193 +0000 UTC m=+36.994302831" watchObservedRunningTime="2026-10-31 00:29:19.584249338 +0000 UTC m=+36.994785966"
Oct 31 00:29:20.468494 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.468453    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz4np" event={"ID":"198c39d2-beca-4447-abeb-3b57050cb3f6","Type":"ContainerStarted","Data":"c3fbdb7746f3deb2083261e00814b6120687899bf197ebf71231d6264fb0fb0a"}
Oct 31 00:29:20.468901 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.468549    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:20.471151 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.471123    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xltzg" event={"ID":"1927717c-0969-4669-85cf-da2c7d741f42","Type":"ContainerStarted","Data":"071873e427ae25c226de208e8d16f66850a784469d9db2333f7a155a20c3a17b"}
Oct 31 00:29:20.471871 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.471830    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xltzg" event={"ID":"1927717c-0969-4669-85cf-da2c7d741f42","Type":"ContainerStarted","Data":"c445ba9d076cd4b6cdef3f1470825a26c42edf64140ba214e094fdf6ff891ce9"}
Oct 31 00:29:20.591862 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.591805    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-hz4np" podStartSLOduration=2.655910235 podStartE2EDuration="5.591789822s" totalImagesPullingTime="2.935879587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:20.591236759 +0000 UTC m=+38.001773388" watchObservedRunningTime="2026-10-31 00:29:20.591789822 +0000 UTC m=+38.002326450"
Oct 31 00:29:20.713000 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:20.712878    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xltzg" podStartSLOduration=35.705549498 podStartE2EDuration="37.712858856s" totalImagesPullingTime="2.007309358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:20.712534186 +0000 UTC m=+38.123070814" watchObservedRunningTime="2026-10-31 00:29:20.712858856 +0000 UTC m=+38.123395489"
Oct 31 00:29:21.049957 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:21.049882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:21.475555 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:21.475517    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dggrt" event={"ID":"f8f3537e-25dc-4592-83c7-795b5f1d8af0","Type":"ContainerStarted","Data":"aa8902ba41364298f4ed8496ac408793f8e907fe65de38e4c04faac913ce392a"}
Oct 31 00:29:21.477003 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:21.476971    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mmb5b" event={"ID":"72bc206e-b599-4c37-bb62-9c2d7047a85d","Type":"ContainerStarted","Data":"458f9eb5c7b9d342554ec792ab9ad74845a5892f937479ba194aa7385928cf20"}
Oct 31 00:29:21.598621 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:21.598542    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dggrt" podStartSLOduration=2.760640931 podStartE2EDuration="6.598527421s" totalImagesPullingTime="3.83788649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:21.598140822 +0000 UTC m=+39.008677451" watchObservedRunningTime="2026-10-31 00:29:21.598527421 +0000 UTC m=+39.009064047"
Oct 31 00:29:21.718559 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:21.718505    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mmb5b" podStartSLOduration=2.270524414 podStartE2EDuration="6.718490902s" totalImagesPullingTime="4.447966488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:21.717995401 +0000 UTC m=+39.128532028" watchObservedRunningTime="2026-10-31 00:29:21.718490902 +0000 UTC m=+39.129027528"
Oct 31 00:29:22.331406 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:22.331365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:22.482292 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:22.482250    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b57f57c9-zpb6f" event={"ID":"af81ff8e-3a14-417d-9bd9-705389fb906b","Type":"ContainerStarted","Data":"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"}
Oct 31 00:29:22.611053 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:22.610956    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-78b57f57c9-zpb6f" podStartSLOduration=2.423931371 podStartE2EDuration="6.610940688s" totalImagesPullingTime="4.187009317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:22.610405837 +0000 UTC m=+40.020942461" watchObservedRunningTime="2026-10-31 00:29:22.610940688 +0000 UTC m=+40.021477315"
Oct 31 00:29:22.660675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:22.660638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:22.857980 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:22.857943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:23.076963 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.076936    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"]
Oct 31 00:29:23.079269 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.079245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.084780 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.084756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:23.138635 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.138586    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"]
Oct 31 00:29:23.188049 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.188020    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m9htb\""
Oct 31 00:29:23.188217 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.188204    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:29:23.188272 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.188247    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 00:29:23.225406 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.225368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpp55\" (UniqueName: \"kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.225557 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.225442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.225666 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.225556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.225789 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.225701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.254399 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.254361    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"]
Oct 31 00:29:23.256896 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.256875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.263957 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.263936    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jwdtq"]
Oct 31 00:29:23.265972 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.265957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.313711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.313677    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 00:29:23.320225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.320199    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 00:29:23.326568 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.326540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.326696 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.326584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.326696 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.326673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.326810 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.326715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpp55\" (UniqueName: \"kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.327335 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.327279    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.329084 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.329064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.329171 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.329118    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.345107 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.343734    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"]
Oct 31 00:29:23.356024 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.355992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:23.358880 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358854    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 00:29:23.358880 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358854    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:29:23.359065 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358901    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mqw2c\""
Oct 31 00:29:23.359065 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358901    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 00:29:23.359065 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358942    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wlc7r\""
Oct 31 00:29:23.359065 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.358984    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 00:29:23.392776 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.392747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpp55\" (UniqueName: \"kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.393485 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.393469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:23.428050 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428214 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.428214 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.428214 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.428319 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.428319 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428319 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q629\" (UniqueName: \"kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.428415 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428415 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v6kh\" (UniqueName: \"kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428415 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.428584 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.428551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529034 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529034 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529164    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529429    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.529548 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q629\" (UniqueName: \"kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529803    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6kh\" (UniqueName: \"kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.529994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530076    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530541 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530318    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.530624 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530578    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.530869 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530848    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530959 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530884    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.530959 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.530926    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.532325 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.532292    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.532435 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.532337    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.532435 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.532343    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.532435 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.532360    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.597314 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.597223    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6kh\" (UniqueName: \"kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.597450 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.597371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q629\" (UniqueName: \"kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.604636 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.604581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:23.795422 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.795389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:23.823100 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.823045    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"]
Oct 31 00:29:23.826155 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:23.826133    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bff60fc_622d_4b2d_a935_537b4e9c3ae2.slice/crio-4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a WatchSource:0}: Error finding container 4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a: Status 404 returned error can't find the container with id 4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a
Oct 31 00:29:23.869648 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.869628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:23.878749 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:23.878728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:23.890330 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:23.890303    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcc5163_4382_4160_b05b_b6f745faafdb.slice/crio-ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f WatchSource:0}: Error finding container ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f: Status 404 returned error can't find the container with id ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f
Oct 31 00:29:24.303172 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.303144    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"]
Oct 31 00:29:24.305749 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:24.305729    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611b4aab_bbce_4c31_8074_f79ff52f2cd1.slice/crio-d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60 WatchSource:0}: Error finding container d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60: Status 404 returned error can't find the container with id d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60
Oct 31 00:29:24.490830 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.490797    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2" event={"ID":"611b4aab-bbce-4c31-8074-f79ff52f2cd1","Type":"ContainerStarted","Data":"d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60"}
Oct 31 00:29:24.491948 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.491920    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwdtq" event={"ID":"8bcc5163-4382-4160-b05b-b6f745faafdb","Type":"ContainerStarted","Data":"ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f"}
Oct 31 00:29:24.493837 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.493814    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl" event={"ID":"8bff60fc-622d-4b2d-a935-537b4e9c3ae2","Type":"ContainerStarted","Data":"5977e35a6a8765f482a335a985ec04d014730a1bb9a595facf50e8d4ec12dc28"}
Oct 31 00:29:24.493961 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.493856    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl" event={"ID":"8bff60fc-622d-4b2d-a935-537b4e9c3ae2","Type":"ContainerStarted","Data":"d691080e08d99f7470a7436db740bdb35629e972718db99f243a11f8d96da2b2"}
Oct 31 00:29:24.493961 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.493874    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl" event={"ID":"8bff60fc-622d-4b2d-a935-537b4e9c3ae2","Type":"ContainerStarted","Data":"4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a"}
Oct 31 00:29:24.599180 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.599103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:24.798378 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:24.798344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:25.307412 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.307379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:25.360086 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.360053    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:29:25.364035 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.363341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.443518 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.443478    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 00:29:25.471489 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471393    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 00:29:25.471489 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471422    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 00:29:25.471489 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471414    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-skrl7\""
Oct 31 00:29:25.471489 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471456    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 00:29:25.471489 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471491    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 00:29:25.471950 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471550    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 00:29:25.471950 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471557    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 00:29:25.471950 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.471576    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 00:29:25.473389 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.473297    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:29:25.544384 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544537 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544537 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544537 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544537 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544746 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.544986 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.544765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.545763 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.545739    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 00:29:25.645569 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.645962 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.646466 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.645986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.646466 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.646083    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.647485 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.647446    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.648357 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.648238    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.651372 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.651346    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.651715 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.651689    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.651950 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.651933    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.653033 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.653008    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.653430 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.653408    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.654064 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.654038    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.654283 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.654267    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.654340 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.654304    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.654747 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.654730    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.691880 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.691856    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-554698664c-x6vzb"]
Oct 31 00:29:25.694592 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.694570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.718752 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.718729    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:25.756847 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.756815    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 31 00:29:25.759700 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.759668    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jb528\""
Oct 31 00:29:25.759922 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.759897    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bu2h4pj0qeqbr\""
Oct 31 00:29:25.760025 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.759927    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 31 00:29:25.760025 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.760007    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 31 00:29:25.760123 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.760030    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 31 00:29:25.761804 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.761768    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 31 00:29:25.766817 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.766787    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-554698664c-x6vzb"]
Oct 31 00:29:25.847106 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847220 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847336 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847449 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847500 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847500 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847616 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.847686 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.847641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgr7\" (UniqueName: \"kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.948801 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.948768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.948944 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.948838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.948944 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.948869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.948944 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.948888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.948944 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.948923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.949123 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.949001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.949123 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.949024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.949123 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.949049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.949123 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.949085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgr7\" (UniqueName: \"kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.949444 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.949418    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.950471 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.950446    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.951571 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.951539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.951757 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.951737    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.951944 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.951925    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.952013 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.951994    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.952195 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.952177    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.952311 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.952293    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:25.987519 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:25.987494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:26.013869 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.013845    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgr7\" (UniqueName: \"kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:26.313628 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.313532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:26.434151 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.434120    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:29:26.436758 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:26.436730    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07275759_29b2_4d6d_8c25_9e80e907d310.slice/crio-a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414 WatchSource:0}: Error finding container a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414: Status 404 returned error can't find the container with id a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414
Oct 31 00:29:26.502916 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.502888    2580 generic.go:356] "Generic (PLEG): container finished" podID="8bcc5163-4382-4160-b05b-b6f745faafdb" containerID="ff73a8c6fa6c3a34a9a69dd3889fa1f86b8231619b23d5b77ba7f92a125b696d" exitCode=0
Oct 31 00:29:26.503038 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.502962    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwdtq" event={"ID":"8bcc5163-4382-4160-b05b-b6f745faafdb","Type":"ContainerDied","Data":"ff73a8c6fa6c3a34a9a69dd3889fa1f86b8231619b23d5b77ba7f92a125b696d"}
Oct 31 00:29:26.504198 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.504176    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414"}
Oct 31 00:29:26.506260 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.506239    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl" event={"ID":"8bff60fc-622d-4b2d-a935-537b4e9c3ae2","Type":"ContainerStarted","Data":"4613ff0b5a3949e66485d167920b0ab22698c72f436ac99ced5a094b4ca814c1"}
Oct 31 00:29:26.704996 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.704962    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-554698664c-x6vzb"]
Oct 31 00:29:26.708246 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:26.708218    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf645cc8_1325_4315_94b3_470599cf28e8.slice/crio-d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb WatchSource:0}: Error finding container d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb: Status 404 returned error can't find the container with id d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb
Oct 31 00:29:26.748773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.748724    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl" podStartSLOduration=2.068471793 podStartE2EDuration="3.74870897s" totalImagesPullingTime="1.680237177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:26.747692337 +0000 UTC m=+44.158228964" watchObservedRunningTime="2026-10-31 00:29:26.74870897 +0000 UTC m=+44.159245596"
Oct 31 00:29:26.920877 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.920847    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:26.921048 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.920903    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:26.926507 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:26.926479    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:27.178771 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.178627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:27.369439 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.369355    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:27.512531 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.512451    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwdtq" event={"ID":"8bcc5163-4382-4160-b05b-b6f745faafdb","Type":"ContainerStarted","Data":"189307bf0a9d67cfb8a1241939b8a381b7ed48d992682048d26532f291b03726"}
Oct 31 00:29:27.512531 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.512519    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwdtq" event={"ID":"8bcc5163-4382-4160-b05b-b6f745faafdb","Type":"ContainerStarted","Data":"37ea43ab7a0eadce52f88ada223c888f45dad05fae4db6c34110de7e6c156e8b"}
Oct 31 00:29:27.515031 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.515003    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2" event={"ID":"611b4aab-bbce-4c31-8074-f79ff52f2cd1","Type":"ContainerStarted","Data":"809a1c8e7c33f93b221d813a5b4ff79750bf42b3a39493e03aa09a82f09ce029"}
Oct 31 00:29:27.515144 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.515051    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2" event={"ID":"611b4aab-bbce-4c31-8074-f79ff52f2cd1","Type":"ContainerStarted","Data":"d5aa4efb36be1b0b04e07804e79ef5425521012b8f55c2944d28763dbd14df8f"}
Oct 31 00:29:27.515144 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.515076    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2" event={"ID":"611b4aab-bbce-4c31-8074-f79ff52f2cd1","Type":"ContainerStarted","Data":"b238d6b00c23a67f6f394406e5ae1e3cb476aca614054077a072eedfa25e579a"}
Oct 31 00:29:27.516255 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.516228    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb"}
Oct 31 00:29:27.520252 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.520237    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:27.576722 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.576687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:27.648984 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.648935    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jwdtq" podStartSLOduration=2.82141976 podStartE2EDuration="4.648911987s" totalImagesPullingTime="1.740833776s" totalInitContainerRuntime="86.658451ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:27.644534199 +0000 UTC m=+45.055070827" watchObservedRunningTime="2026-10-31 00:29:27.648911987 +0000 UTC m=+45.059448611"
Oct 31 00:29:27.751423 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.751389    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"]
Oct 31 00:29:27.772006 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.771914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:27.773350 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.773301    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2" podStartSLOduration=2.589646682 podStartE2EDuration="4.773279146s" totalImagesPullingTime="2.183632464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:27.772621737 +0000 UTC m=+45.183158357" watchObservedRunningTime="2026-10-31 00:29:27.773279146 +0000 UTC m=+45.183815773"
Oct 31 00:29:27.810831 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.810758    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"]
Oct 31 00:29:27.812203 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.812162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:27.868322 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.868284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:27.868322 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.868325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2vx\" (UniqueName: \"kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:27.874532 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.874510    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 00:29:27.874532 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.874520    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cjt6r\""
Oct 31 00:29:27.969515 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.969470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:27.969716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.969521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2vx\" (UniqueName: \"kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:27.974174 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:27.974149    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:28.039466 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.039391    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2vx\" (UniqueName: \"kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:28.053396 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.053359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:28.066761 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.066733    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-767548898d-bt8ls"]
Oct 31 00:29:28.093509 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.093477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.101118 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.100935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:28.127719 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.127630    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-767548898d-bt8ls"]
Oct 31 00:29:28.150165 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150115    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6cj6h\""
Oct 31 00:29:28.150165 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150143    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 31 00:29:28.150378 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150252    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 31 00:29:28.150667 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150280    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 00:29:28.150765 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150442    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 31 00:29:28.150765 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.150538    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a8mpo1anopo2v\""
Oct 31 00:29:28.273169 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273169 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273169 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273436 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273436 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql9q\" (UniqueName: \"kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273436 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.273436 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.273396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374354 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374354 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql9q\" (UniqueName: \"kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.374567 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.374462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.375813 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.375087    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.375813 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.375743    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.376711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.376655    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.377193 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.377172    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.380146 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.380125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.382067 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.382040    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.443807 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.443691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql9q\" (UniqueName: \"kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.535954 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.535921    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"]
Oct 31 00:29:28.726777 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.726730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:28.862545 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.862511    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-566b5dddf-4lwr4"]
Oct 31 00:29:28.882484 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.882455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938079    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938211    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938397    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938404    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bx8qq\""
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938441    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 31 00:29:28.945631 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.938458    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 31 00:29:28.981223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981223 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbrxk\" (UniqueName: \"kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.981462 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.981372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:28.991232 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.991138    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 31 00:29:28.991971 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:28.991912    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566b5dddf-4lwr4"]
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrxk\" (UniqueName: \"kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.084745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.085894    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.088455 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.086144    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.090561 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.089252    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.090561 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.089279    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.099305 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.098783    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.099305 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.099257    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.099553 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.099507    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.155039 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.154976    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrxk\" (UniqueName: \"kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.255869 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.255785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:29.332203 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.332103    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-767548898d-bt8ls"]
Oct 31 00:29:29.352527 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:29.352455    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639d9b02_4e18_4090_905b_8ca6d4d8352a.slice/crio-369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1 WatchSource:0}: Error finding container 369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1: Status 404 returned error can't find the container with id 369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1
Oct 31 00:29:29.526094 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.526019    2580 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c" exitCode=0
Oct 31 00:29:29.526238 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.526111    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"}
Oct 31 00:29:29.529244 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.529142    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-767548898d-bt8ls" event={"ID":"639d9b02-4e18-4090-905b-8ca6d4d8352a","Type":"ContainerStarted","Data":"369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1"}
Oct 31 00:29:29.537661 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.535214    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc" event={"ID":"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac","Type":"ContainerStarted","Data":"98cb77d9d8e14599ba84d023b3c6ab155dc5832d62527885605eff691538c987"}
Oct 31 00:29:29.753634 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:29.753440    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566b5dddf-4lwr4"]
Oct 31 00:29:30.470675 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:30.470635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:30.481807 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:30.481779    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:30.552742 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:30.552703    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4" event={"ID":"77822f8f-dc1d-4774-99dd-673286558e56","Type":"ContainerStarted","Data":"f879d1a1c1e0f4df88d5e8530421308f0673a3574aa1098b095782d1a0d836af"}
Oct 31 00:29:30.796151 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:30.796005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:31.565924 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:31.565890    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"1e955a954dd55e54cd11cae1ceadce1e6943461a6a8a3c3bffe5a2868b371581"}
Oct 31 00:29:31.566294 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:31.565979    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"75da4d529f591c884f3dce64f0575e05712dea6e8d7979cab8faa397233f7be0"}
Oct 31 00:29:31.597790 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:31.597409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:31.817899 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:31.817821    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:32.033822 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.033788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:32.400930 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.399752    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:29:32.424958 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.424927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.434288 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.434222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:32.468196 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.468168    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:29:32.516627 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.516541    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:29:32.516794 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.516774    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:29:32.516936 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.516823    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fs297cs649aha\""
Oct 31 00:29:32.517159 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.517132    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-958gj\""
Oct 31 00:29:32.517280 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.517213    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:29:32.525660 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.525781 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.525781 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.525883 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.525938 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.525938 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526036 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526036 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526036 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.525994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526036 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526225 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526544 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526544 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.526544 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.526289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.540071 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.540033    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:29:32.540376 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.540354    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:29:32.540711 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.540680    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:29:32.573124 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.573096    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc" event={"ID":"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac","Type":"ContainerStarted","Data":"426f0773d74013a9785e9ce8586e21d5a95f626038e7e176349056a40efc8e13"}
Oct 31 00:29:32.573510 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.573164    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:32.575367 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.575341    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-767548898d-bt8ls" event={"ID":"639d9b02-4e18-4090-905b-8ca6d4d8352a","Type":"ContainerStarted","Data":"ce43cbc9cc6332f4a8bd311dd75d3eaf244ee4e9a33fdca4bedced78dcf2e23f"}
Oct 31 00:29:32.580524 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.580420    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"edc8e9f616b195b582911058e79b49a5829c93da86ffed4d2da00aa3525c8123"}
Oct 31 00:29:32.581741 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.581699    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:32.627425 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.627552 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.627552 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.627707 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.627940 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.627975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628029 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628127    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628422 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628422 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628422 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.628773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.630586 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.629950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.630586 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.630271    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.630877 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.630857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.630919 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.630866    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.631166 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.628519    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.631282 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.631257    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.631441 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.631425    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.631669 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.631647    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.631802 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.631786    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.633152 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.633130    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.641522 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.641388    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:29:32.641522 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.641405    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:29:32.641522 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.641432    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:29:32.641522 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.641439    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:29:32.641522 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.641489    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:29:32.642228 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.642212    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:29:32.642316 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.642275    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:29:32.642581 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.642550    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:29:32.650439 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.650386    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.651657 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.651242    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.651657 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.651570    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.652001 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.651979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.652298 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.652276    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.653196 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.653172    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.653460 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.653443    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.653581 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.653559    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.697868 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.697839    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.769418 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.769343    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc" podStartSLOduration=2.78373308 podStartE2EDuration="5.769328242s" totalImagesPullingTime="2.985595162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:32.768428059 +0000 UTC m=+50.178964684" watchObservedRunningTime="2026-10-31 00:29:32.769328242 +0000 UTC m=+50.179864886"
Oct 31 00:29:32.835158 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.835134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:32.901300 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:32.900919    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-767548898d-bt8ls" podStartSLOduration=2.021252281 podStartE2EDuration="4.900897455s" totalImagesPullingTime="2.879645174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:32.89850835 +0000 UTC m=+50.309044989" watchObservedRunningTime="2026-10-31 00:29:32.900897455 +0000 UTC m=+50.311434088"
Oct 31 00:29:33.307984 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.307689    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:29:33.311433 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:33.311392    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae86b63_5c86_4f8b_92eb_b069c6412c5a.slice/crio-9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0 WatchSource:0}: Error finding container 9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0: Status 404 returned error can't find the container with id 9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0
Oct 31 00:29:33.590421 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.590158    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"}
Oct 31 00:29:33.590421 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.590258    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"}
Oct 31 00:29:33.590421 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.590299    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"}
Oct 31 00:29:33.590421 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.590334    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"}
Oct 31 00:29:33.590421 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.590373    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"}
Oct 31 00:29:33.593426 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.593324    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4" event={"ID":"77822f8f-dc1d-4774-99dd-673286558e56","Type":"ContainerStarted","Data":"a058a31196b98791de56727dca4ea84ba1e9216562e8131b7d3c326311cb464f"}
Oct 31 00:29:33.593426 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.593384    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4" event={"ID":"77822f8f-dc1d-4774-99dd-673286558e56","Type":"ContainerStarted","Data":"8d644a03a168429114cbd534a05c3bf6daa814cb7c4bc50256af5847295a8b39"}
Oct 31 00:29:33.595443 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.595416    2580 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881" exitCode=0
Oct 31 00:29:33.595560 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.595538    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"}
Oct 31 00:29:33.595640 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:33.595580    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0"}
Oct 31 00:29:34.601999 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.601911    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4" event={"ID":"77822f8f-dc1d-4774-99dd-673286558e56","Type":"ContainerStarted","Data":"b78dbe7e2f8fd3ef99d115b5e13d46ca6553b22e4b73b6ece8c006f77cc55c1a"}
Oct 31 00:29:34.604969 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.604943    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"70dd3f4484f464c65270de7877bc061f72762373f28365a2812313b25f3c4e79"}
Oct 31 00:29:34.605081 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.605017    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:34.605081 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.605062    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"789a9b553834567117022af3d3f77dcffafcae038781d657f374174f431b0399"}
Oct 31 00:29:34.605176 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.605103    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" event={"ID":"cf645cc8-1325-4315-94b3-470599cf28e8","Type":"ContainerStarted","Data":"f3bfe7186c7e72a6a1541892dc0b9e5a0e582fc5611144d056bbb70d585995fb"}
Oct 31 00:29:34.608155 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.608132    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerStarted","Data":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"}
Oct 31 00:29:34.730056 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.730004    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4" podStartSLOduration=3.250145714 podStartE2EDuration="6.729989151s" totalImagesPullingTime="3.479843437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:34.728460501 +0000 UTC m=+52.138997129" watchObservedRunningTime="2026-10-31 00:29:34.729989151 +0000 UTC m=+52.140525772"
Oct 31 00:29:34.864051 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.863952    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.129175017 podStartE2EDuration="9.863937429s" totalImagesPullingTime="6.709804643s" totalInitContainerRuntime="24.957769ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:34.862945838 +0000 UTC m=+52.273482464" watchObservedRunningTime="2026-10-31 00:29:34.863937429 +0000 UTC m=+52.274474056"
Oct 31 00:29:34.931630 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:34.931566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:35.017716 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:35.017639    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb" podStartSLOduration=3.168696257 podStartE2EDuration="10.017622478s" totalImagesPullingTime="6.848926221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:35.014675794 +0000 UTC m=+52.425212420" watchObservedRunningTime="2026-10-31 00:29:35.017622478 +0000 UTC m=+52.428159102"
Oct 31 00:29:35.153974 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:35.153510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:36.769178 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.769144    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:29:36.771934 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.771912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.873641 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.873538    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:29:36.876777 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.876744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.876915 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.876820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.876972 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.876948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.877054 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.877033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.877115 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.877090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.877191 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.877175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.877243 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.877212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.877294 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.877250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978372 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978554 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.978773 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.978561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.979265 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.979241    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.979484 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.979454    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.979771 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.979750    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.979874 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.979835    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.980391 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.980370    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.982103 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.982079    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:36.982714 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:36.982689    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:37.047107 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.047028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:37.085128 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.085093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:37.481810 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.481645    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:29:37.484732 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:37.484700    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71604ceb_556f_4409_bf6b_732a6e6196a0.slice/crio-56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c WatchSource:0}: Error finding container 56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c: Status 404 returned error can't find the container with id 56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c
Oct 31 00:29:37.625849 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.625811    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5696d45945-njv6j" event={"ID":"71604ceb-556f-4409-bf6b-732a6e6196a0","Type":"ContainerStarted","Data":"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"}
Oct 31 00:29:37.625996 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.625863    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5696d45945-njv6j" event={"ID":"71604ceb-556f-4409-bf6b-732a6e6196a0","Type":"ContainerStarted","Data":"56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c"}
Oct 31 00:29:37.767879 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:37.767826    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5696d45945-njv6j" podStartSLOduration=1.7678085239999999 podStartE2EDuration="1.767808524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:37.76777216 +0000 UTC m=+55.178308787" watchObservedRunningTime="2026-10-31 00:29:37.767808524 +0000 UTC m=+55.178345152"
Oct 31 00:29:38.419836 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.419809    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:38.565410 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.565379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:38.632946 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.632910    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"}
Oct 31 00:29:38.633096 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.632993    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"}
Oct 31 00:29:38.633096 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.633037    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"}
Oct 31 00:29:38.633096 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.633079    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"}
Oct 31 00:29:38.633186 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.633117    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"}
Oct 31 00:29:38.633186 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.633149    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerStarted","Data":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"}
Oct 31 00:29:38.798835 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.798721    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.665057848 podStartE2EDuration="6.798706784s" totalImagesPullingTime="4.113400986s" totalInitContainerRuntime="20.24795ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:38.797383495 +0000 UTC m=+56.207920122" watchObservedRunningTime="2026-10-31 00:29:38.798706784 +0000 UTC m=+56.209243411"
Oct 31 00:29:38.937665 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:38.937631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:39.236616 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:39.236560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:39.464188 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:39.464151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:40.620422 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:40.620396    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:41.523517 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:41.523480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:41.886289 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:41.886209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:42.277843 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:42.277806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:42.514681 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:42.514652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:42.835740 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:42.835711    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:43.225355 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:43.225295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:43.589106 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:43.589007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:29:46.028972 ip-10-0-143-57 kubenswrapper[2580]: E1031 00:29:46.028934    2580 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:29:47.085802 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:47.085765    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:47.086178 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:47.085841    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:47.090370 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:47.090348    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:47.674807 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:47.674776    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:47.850992 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:47.850957    2580 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:29:48.727787 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:48.727755    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:48.728393 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:48.727832    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:48.996392 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:48.996297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:49.049317 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.049287    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:29:49.059774 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.059747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:49.097099 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.097057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:49.149931 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.149905    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:29:49.210582 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.210555    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:29:49.221070 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.221050    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:49.376953 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.376879    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9b4md\""
Oct 31 00:29:49.377627 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.377585    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6z87r\""
Oct 31 00:29:49.384719 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.384701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:49.385857 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.385843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:49.767847 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.767823    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfth8"]
Oct 31 00:29:49.770495 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:49.770468    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21b4377_105b_4b2f_a7a5_d93dc6f9be39.slice/crio-53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702 WatchSource:0}: Error finding container 53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702: Status 404 returned error can't find the container with id 53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702
Oct 31 00:29:49.817858 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:49.817831    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpc6d"]
Oct 31 00:29:49.820895 ip-10-0-143-57 kubenswrapper[2580]: W1031 00:29:49.820873    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7eb1ae_0643_472e_a33c_4c7c3b88a266.slice/crio-d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91 WatchSource:0}: Error finding container d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91: Status 404 returned error can't find the container with id d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91
Oct 31 00:29:50.682982 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:50.682945    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tpc6d" event={"ID":"8c7eb1ae-0643-472e-a33c-4c7c3b88a266","Type":"ContainerStarted","Data":"d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91"}
Oct 31 00:29:50.684088 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:50.684064    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfth8" event={"ID":"a21b4377-105b-4b2f-a7a5-d93dc6f9be39","Type":"ContainerStarted","Data":"53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702"}
Oct 31 00:29:54.535251 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:54.535165    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:54.594124 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:54.594096    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:54.710696 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:54.710657    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfth8" event={"ID":"a21b4377-105b-4b2f-a7a5-d93dc6f9be39","Type":"ContainerStarted","Data":"48502394d687ccdd6aa2d08894596e6f685f29922f6e1f59ca7f63c8e5645076"}
Oct 31 00:29:54.710866 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:54.710817    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:54.728146 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:54.728116    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:55.089290 ip-10-0-143-57 kubenswrapper[2580]: I1031 00:29:55.089233    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lfth8" podStartSLOduration=67.631297611 podStartE2EDuration="1m12.089219232s" totalImagesPullingTime="4.457921621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:29:55.088430039 +0000 UTC m=+72.498966679" watchObservedRunningTime="2026-10-31 00:29:55.089219232 +0000 UTC m=+72.499755861"
Oct 31 00:29:55.567479 ip-10-0-143-57 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 00:29:55.578335 ip-10-0-143-57 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 00:29:55.578501 ip-10-0-143-57 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 00:29:55.578551 ip-10-0-143-57 systemd[1]: kubelet.service: Consumed 5.164s CPU time.
Oct 31 00:29:55.591433 ip-10-0-143-57 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:29:55.662119 ip-10-0-143-57 kubenswrapper[7559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:29:55.662119 ip-10-0-143-57 kubenswrapper[7559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:29:55.662119 ip-10-0-143-57 kubenswrapper[7559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:29:55.662119 ip-10-0-143-57 kubenswrapper[7559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:29:55.664524 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664424    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.664524 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664519    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.664524 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664524    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.664524 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664528    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.664524 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664533    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664539    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664544    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664547    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664551    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664555    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664560    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664563    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664567    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664570    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664574    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664578    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664583    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664586    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664591    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664612    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664617    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664621    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664625    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664629    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.664889 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664632    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664636    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664649    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664653    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664657    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664661    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664665    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664669    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664673    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664677    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664681    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664685    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664690    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664694    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664698    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664703    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664707    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664712    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664716    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.665789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664721    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664725    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664730    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664735    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664739    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664743    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664747    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664751    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664756    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664761    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664766    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664770    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664775    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664779    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664783    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664788    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664793    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664802    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664808    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.666656 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664815    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664822    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664828    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664832    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664836    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664841    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664845    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664851    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664856    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664860    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664865    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664869    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664874    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664878    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664882    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664886    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664891    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664895    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664900    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664904    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.667500 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664908    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664912    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664921    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664925    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664929    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664933    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664938    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664942    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664946    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664951    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664956    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664962    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664966    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664972    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664976    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664980    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664984    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664989    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664993    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.664997    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.668407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.665001    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.665005    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.665009    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.665014    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666427    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666438    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666443    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666449    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666454    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666459    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666464    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666469    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666473    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666477    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666485    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666489    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666493    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666498    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666502    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666507    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.669326 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666511    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666515    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666519    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666533    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666537    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666543    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666548    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666552    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666557    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666561    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666566    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666570    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666577    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666583    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666588    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666593    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666617    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666622    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666626    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.670265 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666631    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666635    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666639    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666643    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666647    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666651    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666655    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666662    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666666    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666670    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666674    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666678    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666683    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666688    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666692    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666696    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666700    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666717    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666722    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.671150 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666726    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666731    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666736    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666740    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666745    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666749    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666753    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666758    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666762    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666766    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666770    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666774    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666779    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666783    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666787    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666791    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666797    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666804    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666809    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.671745 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666814    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666822    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666826    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666831    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666835    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666839    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666843    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666848    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666852    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666856    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666860    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666865    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666877    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666882    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666886    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666891    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666895    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666899    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666903    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666908    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.672233 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666912    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666916    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666920    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666926    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666931    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666935    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666939    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666943    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666947    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666951    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666955    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666959    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.666964    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667924    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667935    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667940    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667944    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667948    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667952    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667957    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.672789 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667962    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667968    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667975    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667980    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667985    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667990    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667994    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.667998    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668003    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668007    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668011    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668015    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668020    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668024    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668028    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668032    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668036    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668040    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668045    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668049    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.673344 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668053    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668058    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668062    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668066    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668070    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668075    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668079    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668084    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668088    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668092    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668096    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668100    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668104    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668109    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668113    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668117    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668122    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668127    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668132    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668136    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.673880 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668140    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668144    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668148    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668153    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668157    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668161    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668165    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668169    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668173    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668178    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668182    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668186    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668190    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668194    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668198    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668203    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668207    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668211    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668216    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668220    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.674380 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668224    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668229    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668233    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668237    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668243    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668250    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668256    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668261    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668268    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668272    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668277    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668281    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668285    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668290    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668294    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668298    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668302    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668306    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668311    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.674896 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668315    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668319    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668323    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668328    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668332    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668337    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668341    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668345    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668349    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668354    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668358    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668362    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668366    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668370    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668374    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668379    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668383    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668387    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668391    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.668397    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.675361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668543    7559 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668563    7559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668573    7559 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668580    7559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668588    7559 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668612    7559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668619    7559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668626    7559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668631    7559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668635    7559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668642    7559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668647    7559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668652    7559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668657    7559 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668661    7559 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668666    7559 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668670    7559 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668675    7559 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668682    7559 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668687    7559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668692    7559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668697    7559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668702    7559 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668708    7559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:29:55.675876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668713    7559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668719    7559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668724    7559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668729    7559 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668734    7559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668739    7559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668743    7559 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668748    7559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668755    7559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668762    7559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668767    7559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668772    7559 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668779    7559 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668784    7559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668792    7559 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668797    7559 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668802    7559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668807    7559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668812    7559 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668819    7559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668824    7559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668828    7559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668833    7559 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668838    7559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668843    7559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:29:55.676667 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668848    7559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668853    7559 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668859    7559 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668863    7559 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668868    7559 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668875    7559 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668880    7559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668885    7559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668890    7559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668895    7559 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668901    7559 flags.go:64] FLAG: --help="false"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668906    7559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668911    7559 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668916    7559 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668921    7559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668927    7559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668935    7559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668941    7559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668946    7559 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668952    7559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668957    7559 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668963    7559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668969    7559 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668973    7559 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:29:55.678081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668978    7559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668982    7559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668988    7559 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668992    7559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.668997    7559 flags.go:64] FLAG: --lock-file=""
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669002    7559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669007    7559 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669011    7559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669020    7559 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669025    7559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669030    7559 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669035    7559 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669040    7559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669045    7559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669050    7559 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669054    7559 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669062    7559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669066    7559 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669073    7559 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669079    7559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669084    7559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669089    7559 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669093    7559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669098    7559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669105    7559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:29:55.679100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669109    7559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669121    7559 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669129    7559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669134    7559 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669139    7559 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669144    7559 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669149    7559 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669154    7559 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669158    7559 flags.go:64] FLAG: --port="10250"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669164    7559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669168    7559 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-075e7b268782ec67d"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669174    7559 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669179    7559 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669183    7559 flags.go:64] FLAG: --register-node="true"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669188    7559 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669194    7559 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669199    7559 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669204    7559 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669208    7559 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669215    7559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669219    7559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669224    7559 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669229    7559 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669234    7559 flags.go:64] FLAG: --runonce="false"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669239    7559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669245    7559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669250    7559 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:29:55.680213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669255    7559 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669260    7559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669265    7559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669270    7559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669276    7559 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669281    7559 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669285    7559 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669292    7559 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669297    7559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669302    7559 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669307    7559 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669312    7559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669321    7559 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669325    7559 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669330    7559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669336    7559 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669340    7559 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669344    7559 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669349    7559 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669354    7559 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669359    7559 flags.go:64] FLAG: --v="2"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669374    7559 flags.go:64] FLAG: --version="false"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669380    7559 flags.go:64] FLAG: --vmodule=""
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669386    7559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.669392    7559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:29:55.681404 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669646    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669654    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669658    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669663    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669667    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669671    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669676    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669681    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669685    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669689    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669694    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669700    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669705    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669709    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669714    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669719    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669723    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669727    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669731    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.682509 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669737    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669742    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669746    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669751    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669754    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669759    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669763    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669768    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669772    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669776    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669780    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669785    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669789    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669794    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669798    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669803    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669807    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669811    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669815    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.683351 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669819    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669823    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669827    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669832    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669836    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669842    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669846    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669851    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669856    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669860    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669865    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669869    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669874    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669878    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669888    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669892    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669897    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669901    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669906    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669910    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.684254 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669914    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669918    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669923    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669927    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669931    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669935    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669940    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669944    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669948    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669952    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669956    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669961    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669965    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669970    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669974    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669978    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669982    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669988    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669992    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.669997    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.685169 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670003    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670008    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670012    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670016    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670020    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670024    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670029    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670034    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670038    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670042    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670046    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670050    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670054    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670059    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670063    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670071    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670076    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670082    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670087    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.686110 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670091    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670097    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670102    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670107    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670111    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670116    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670120    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670124    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670128    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.670174    7559 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670232    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670242    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670248    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670253    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670261    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670266    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.687068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670270    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670274    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670278    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670282    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670286    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670293    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670298    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670303    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670307    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670312    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670316    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670320    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670324    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670330    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670334    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670338    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670342    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670347    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670351    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670356    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.687863 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670360    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670364    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670368    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670373    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670377    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670381    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670385    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670389    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670393    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670398    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670404    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670409    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670413    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670417    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670421    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670425    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670429    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670434    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670439    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670444    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.688610 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670448    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670452    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670456    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670460    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670464    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670468    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670473    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670477    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670482    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670486    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670490    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670495    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670499    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670505    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670511    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670518    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670523    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670527    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670532    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.689107 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670538    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670543    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670548    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670555    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670559    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670564    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670568    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670573    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670577    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670581    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670585    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670589    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670613    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670618    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670622    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670627    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670632    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670638    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670643    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.689579 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670647    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670651    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670656    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670660    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670664    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670668    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670672    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670676    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670680    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670684    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670689    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670693    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670697    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670702    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670706    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670710    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670717    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670721    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670726    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.690068 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670730    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670735    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.670741    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.675117    7559 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.675134    7559 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.675153    7559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.675157    7559 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675228    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675233    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675236    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675239    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675242    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675245    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675248    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675253    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675258    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675268    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675271    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675275    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675278    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.690661 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675286    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675289    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675292    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675294    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675297    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675299    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675302    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675305    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675307    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675310    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675313    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675316    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675319    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675321    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675324    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675327    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675329    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675332    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675334    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675337    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.691179 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675339    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675342    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675344    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675347    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675350    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675352    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675355    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675357    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675360    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675368    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675371    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675374    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675376    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675379    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675381    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675384    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675387    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675390    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675392    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.691772 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675395    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675398    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675400    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675403    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675405    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675408    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675410    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675413    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675415    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675418    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675420    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675423    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675425    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675428    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675432    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675435    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675438    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675441    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675444    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.692243 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675447    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675449    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675452    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675454    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675462    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675465    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675467    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675470    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675472    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675475    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675477    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675480    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675483    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675486    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675488    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675491    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675494    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675496    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675499    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675501    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.692854 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675504    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675506    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675508    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675511    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675513    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675516    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675519    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675521    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675524    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675526    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675529    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675531    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675533    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675536    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675538    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.693345 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.675566    7559 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675793    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675804    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675808    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675811    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675813    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675816    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675819    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675821    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675824    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675827    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675829    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675832    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675834    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675837    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675839    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675842    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675844    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675847    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675849    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.693740 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675852    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675854    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675857    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675859    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675862    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675864    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675866    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675869    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675871    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675874    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675876    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675879    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675882    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675884    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675887    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675895    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675898    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675900    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675903    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.694272 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675906    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675908    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675911    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675913    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675916    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675919    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675921    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675924    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675926    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675928    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675931    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675933    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675936    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675938    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675940    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675943    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675945    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675948    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675950    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675953    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.694763 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675955    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675958    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675960    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675962    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675965    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675967    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675969    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675972    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675974    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675982    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675986    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675990    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675993    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.675997    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676001    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676006    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676009    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676011    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676013    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.695259 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676016    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676018    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676021    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676023    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676026    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676028    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676031    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676033    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676036    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676038    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676041    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676043    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676045    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676048    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676052    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676055    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676057    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676060    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676062    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.695750 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676065    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676067    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676070    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676073    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676097    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676100    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676103    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676105    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676108    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676111    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.676136    7559 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676182    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676186    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676189    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676192    7559 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676194    7559 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:29:55.696235 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676197    7559 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676200    7559 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676202    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676205    7559 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676207    7559 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676209    7559 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676212    7559 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676215    7559 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676217    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676219    7559 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676222    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676226    7559 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676231    7559 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676235    7559 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676239    7559 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676242    7559 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676246    7559 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676249    7559 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676252    7559 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:29:55.696668 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676279    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676283    7559 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676294    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676297    7559 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676299    7559 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676302    7559 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676306    7559 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676309    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676311    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676314    7559 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676316    7559 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676319    7559 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676321    7559 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676324    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676326    7559 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676329    7559 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676331    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676334    7559 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676336    7559 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676339    7559 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:29:55.697135 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676341    7559 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676344    7559 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676346    7559 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676349    7559 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676351    7559 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676355    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676357    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676359    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676362    7559 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676365    7559 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676367    7559 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676370    7559 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676372    7559 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676374    7559 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676377    7559 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676387    7559 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676391    7559 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676393    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676398    7559 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676400    7559 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:29:55.697649 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676403    7559 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676405    7559 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676408    7559 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676410    7559 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676413    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676415    7559 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676418    7559 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676420    7559 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676423    7559 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676425    7559 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676428    7559 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676430    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676433    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676435    7559 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676438    7559 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676440    7559 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676443    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676446    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676449    7559 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676451    7559 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:29:55.698148 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676454    7559 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676456    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676459    7559 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676461    7559 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676464    7559 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676466    7559 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676469    7559 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676471    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676479    7559 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676482    7559 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676485    7559 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676488    7559 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676490    7559 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676494    7559 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676496    7559 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676499    7559 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676501    7559 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676504    7559 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676506    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:29:55.698672 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676508    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676511    7559 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:29:55.676513    7559 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.676967    7559 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.680047    7559 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.680120    7559 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.680715    7559 server.go:1014] "Starting client certificate rotation"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.681334    7559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.682942    7559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.682974    7559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:23:43 +0000 UTC" deadline="2028-04-12 04:36:42.656790279 +0000 UTC"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.682998    7559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12700h6m46.973793572s"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.683051    7559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.684756    7559 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.686746    7559 log.go:25] "Validated CRI v1 image API"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.687555    7559 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:29:55.699155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.690129    7559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9bf6b89d-9300-4124-8c38-a2697e736e07:/dev/nvme0n1p4 b0071800-e8ae-4b62-a0fc-e4debfddf8d5:/dev/nvme0n1p3]
Oct 31 00:29:55.699563 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.690149    7559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1/userdata/shm major:0 minor:395 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a/userdata/shm major:0 minor:300 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702/userdata/shm major:0 minor:560 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c/userdata/shm major:0 minor:517 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e/userdata/shm major:0 minor:210 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/98cb77d9d8e14599ba84d023b3c6ab155dc5832d62527885605eff691538c987/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/98cb77d9d8e14599ba84d023b3c6ab155dc5832d62527885605eff691538c987/userdata/shm major:0 minor:387 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0/userdata/shm major:0 minor:465 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414/userdata/shm major:0 minor:350 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f/userdata/shm major:0 minor:312 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91/userdata/shm major:0 minor:561 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60/userdata/shm major:0 minor:317 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f879d1a1c1e0f4df88d5e8530421308f0673a3574aa1098b095782d1a0d836af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f879d1a1c1e0f4df88d5e8530421308f0673a3574aa1098b095782d1a0d836af/userdata/shm major:0 minor:398 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~projected/kube-api-access-dmmvp:{mountpoint:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~projected/kube-api-access-dmmvp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/alertmanager/9 major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/config-reloader/6 major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~empty-dir/config-out major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/kube-api-access-6px58:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/kube-api-access-6px58 major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/tls-assets major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/config-volume major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/web-config major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~projected/kube-api-access-wfgdz:{mountpoint:/var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~projected/kube-api-access-wfgdz major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~secret/metrics-certs major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~projected/kube-api-access-hzg6t:{mountpoint:/var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~projected/kube-api-access-hzg6t major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a7c0204-7117-4e6e-b910-953890e7d582/volumes/kubernetes.io~projected/kube-api-access-cwdz8:{mountpoint:/var/lib/kubelet/pods/3a7c0204-7117-4e6e-b910-953890e7d582/volumes/kubernetes.io~projected/kube-api-access-cwdz8 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5da59575-dc74-4cda-9e57-b9437c54dbd7/volumes/kubernetes.io~projected/kube-api-access-clwjl:{mountpoint:/var/lib/kubelet/pods/5da59575-dc74-4cda-9e57-b9437c54dbd7/volumes/kubernetes.io~projected/kube-api-access-clwjl major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~projected/kube-api-access-4q629:{mountpoint:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~projected/kube-api-access-4q629 major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~projected/kube-api-access-dql9q:{mountpoint:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~projected/kube-api-access-dql9q major:0 minor:392 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:389 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:390 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:391 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~projected/kube-api-access-4jxvr:{mountpoint:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~projected/kube-api-access-4jxvr major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~projected/kube-api-access-qm29s:{mountpoint:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~projected/kube-api-access-qm29s major:0 minor:516 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:511 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:515 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~projected/kube-api-access-8gqcb:{mountpoint:/var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~projected/kube-api-access-8gqcb major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~secret/cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/751d219a-41af-4a6e-9eaf-25879c685574/volumes/kubernetes.io~projected/kube-api-access-x58n4:{mountpoint:/var/lib/kubelet/pods/751d219a-41af-4a6e-9eaf-25879c685574/volumes/kubernetes.io~projected/kube-api-access-x58n4 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~projected/kube-api-access-kbrxk:{mountpoint:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~projected/kube-api-access-kbrxk major:0 minor:397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:399 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:405 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:404 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f8186db-5274-46ad-942c-6aca4b1d1686/volumes/kubernetes.io~projected/kube-api-access-dxj7h:{mountpoint:/var/lib/kubelet/pods/7f8186db-5274-46ad-942c-6aca4b1d1686/volumes/kubernetes.io~projected/kube-api-access-dxj7h major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~projected/kube-api-access-5v6kh:{mountpoint:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~projected/kube-api-access-5v6kh major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~projected/kube-api-access-mpp55:{mountpoint:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~projected/kube-api-access-mpp55 major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c7eb1ae-0643-472e-a33c-4c7c3b88a266/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/8c7eb1ae-0643-472e-a33c-4c7c3b88a266/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:555 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a21b4377-105b-4b2f-a7a5-d93dc6f9be39/volumes/kubernetes.io~projected/kube-api-access-7qv86:{mountpoint:/var/lib/kubelet/pods/a21b4377-105b-4b2f-a7a5-d93dc6f9be39/volumes/kubernetes.io~projected/kube-api-access-7qv86 major:0 minor:559 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2f325f0-14b6-4849-9db1-1def3092575f/volumes/kubernetes.io~projected/kube-api-access-cxh5j:{mountpoint:/var/lib/kubelet/pods/a2f325f0-14b6-4849-9db1-1def3092575f/volumes/kubernetes.io~projected/kube-api-access-cxh5j major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~projected/kube-api-access-rtdtb:{mountpoint:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~projected/kube-api-access-rtdtb major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/config-reloader/2 major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/prometheus/15 major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:441 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/kube-api-access-6sp59:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/kube-api-access-6sp59 major:0 minor:438 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/tls-assets major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/config major:0 minor:453 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:439 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:448 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:449 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:440 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:451 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/web-config major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cdc3eead-3ad0-46f2-b545-ec15921a2ab5/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/cdc3eead-3ad0-46f2-b545-ec15921a2ab5/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~projected/kube-api-access-6vgr7:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~projected/kube-api-access-6vgr7 major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~projected/kube-api-access-5pq6m:{mountpoint:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~projected/kube-api-access-5pq6m major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e/volumes/kubernetes.io~projected/kube-api-access-cgclh:{mountpoint:/var/lib/kubelet/pods/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e/volumes/kubernetes.io~projected/kube-api-access-cgclh major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~projected/kube-api-access-ztw7g:{mountpoint:/var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~projected/kube-api-access-ztw7g major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~projected/kube-api-access-wp2vx:{mountpoint:/var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~projected/kube-api-access-wp2vx major:0 minor:386 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:385 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/4d8fa75baff7ac947bfd5027d86464b868c28a99c963a44d0e314df87fcbfb88/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/151f7f490625a61d84e0c4a862b90cddfb78fbbf9df9c57d98a8c9a358ea9a43/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/6c17dfa7b0ac68d773e2eead8eeb0e3ea143971a3c803aac24dcbb7f02853f3a/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/4895b00e7e23d0488d7260d94d439c7260ee8429e3722da182e397b17c16dfd4/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/41f6ddf30fd2a7385ccbf27c8c58f53dd6f377dff0aedd4ebefbadd790c7d941/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/83ad59ed0d3f8e419b52d971377f495b9d551aa3b4cff2f3643f57b1e1e6b34f/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/c5879b74e38acb936487b35e96a10cefcc22af4e71fd7cd82b1b8b9a1f7d10f1/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/58f6a171d31f92efdb93e75d3831ba2cc3590f811431e489e98efa9b5cb25102/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/d05e22dafc3bb11835eac7e85063f1857c8e658882de13f88f0723711335a477/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/d36b199b308182120aef58bbca04c0c9135522818d44328f458dd9e50c7d2f3f/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/95a64072128b2e1904a3dd5b0eff8a273ff851189a8134aeeb69e3ab3600bb20/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/205ccfc923965303709f1be908760f81e1cbc3ffc164010c46ad017696ee5cdb/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-151:{mountpoint:/var/lib/containers/storage/overlay/088764ea533d19289a52f0d10031115d11997386f769a14efbf155498e905509/merged major:0 minor:151 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/50947fa4f287de4b419ae3f87b98c5aab39209ffc895d8b7a0e22248915c5117/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/7774de7250a36736233d179a7cda9c321dc7bac834c0847b24741cc2762093b8/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/cfef5d0ebec795e72d212553887f185fb7c2ee4f590f554e152a7d742e977a21/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/8f027c5c80d921b64e750fbc9e07c41f0c73c642504c1e42b15a3c47580045d1/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/e2e4352afbb6c63af1c74414ddf9884d3605e62d388daece04fc25bbd47c47ac/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/1aeb46fdeb8aa01707cf8130c91dd0736ee1cd8bad18a68545b0c9c5e0ff13c4/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/8b737b7dde88b64147b4ba09d893e4c34a7a216099a956ceb14a1ed485b32cf7/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/8352bad91ef2328ef0f8e78a394f8ab79c36f18623242ec5a3ebfae2a3522dc3/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/b87f9fddd92a844af35a3dcf07f540dc4099cdf0fdca70accc33c6df2c919d1d/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/6d6d19d5c7c6662b2fce8672971b889fab3175eb301940ef0c1ac13220248026/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/aeb6494ccaef28e83d4270b35eebf2a83910ff3103ae585a74ac4e2edee4f672/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/898a70f6692f5c78e679308d2e95cc33f05a55c25b737dbb7a7357957a82960e/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/a47811508e9700be8f58f7137beae6cecfb4901d056aa15b098f7ac22538fc13/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-238:{mountpoint:/var/lib/containers/storage/overlay/f1127f1e0eb878c20de96f6a7a0da5c0178ebaedaef4c1554e66f0aedd9a8a66/merged major:0 minor:238 fsType:overlay blockSize:0} overlay_0-240:{mountpoint:/var/lib/containers/storage/overlay/942ed9cf6757d53bd3a4346cca9aa259c285aff126908f6f1547ea2cf6ada885/merged major:0 minor:240 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/f003121ceefb91b56f7b4dfa33225a01cfdd31652de41d4ff479ebb5f0e7df04/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/6ec03220a0093a18fcc44d10ebb838dd5e7de95a7944e749f4c27afcfdc07350/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/1c9d2ae43a1680e9525e1e645d077b8e63e79b45a50bc064da8dd4e2e0628cb0/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/a648143aae5a9b18d29d0cc8cce3917f9e82a4222411798037002e5b5b49ce9d/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/f797db7191e429eced1dd1df93ff714c325fdd63f62a0436d275f4f68f4e38ff/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/ca32db92c49c6643b5f1b1fe0d447e9d3a2474ef75da5f2033634d1a63f8b06e/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/e95a35ed13b89923314f843c89378b2c8055225f881221a95e39bea075a2dfac/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/f2b3bc8cd75cb87f8c79bb46862b63141fd46777fb4ef3bab3a27bc5e6a37225/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/254a5909a383d3190e5d293ca14f31d52bef04c7e9dbd481b91e96974bcf5a5d/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/d6ae0859cbd81d130c0a31eb3440a5ea5e6f7e662c6732003b19cdfdf324edc6/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/17cd87b6f2a05a13d6c0d9d1068480a86191703be10c51aa4e61ee8d98e7c483/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/175578bffe55c747fbe9d73447173018c549ac01d2f74157981c7800637599f0/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/9a4d15e10c3dd710a1519921812bb3bbd33655cc7201ace0fc6559c965906d7c/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/03dda10a2419e0d0cd792d6536f30a0eac679422aa1bd769808772f6c45939a4/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/edefc9c20146035ec0bc0280e53b0409e222d95ebb80b839f3b3840b07f6d9d3/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/ec86f4356cde13fb5a94fe14000a92b90538829103e797d5e8c36ad464bef9b6/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/aed642caaa8e44339daa99d91963395a05ab8e9f39edcd0e1e158c20bbb3596a/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/88cdd91a4aa2aab92ee2e1f5f84055ca452ddf467522f3608f31f4b182f19f6d/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/cab2b825432adf17eeed066445bef917460923423f92c27cd1921ba7c932199c/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/f9c021427b643ca781985cdfd30b7145478864c709b94b7e6871f7fc19bf7447/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/8809a41febf364ee66d0d62a12901180b2fcf345a57d4948a94bf7e26abbd143/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/c35a7db8500d3d490f12d91f334a84bde00dfc25a426cdfebc4cec470970972c/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/95564f56a7ee4e35bfc311420899dbef287fc360461677f91ae579bcf6ce11b7/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/db1a4f007e450a32e67318233e1c6f88a0e1101ff2dceb2002c5b3f37c1c904c/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/10443d706ef29beaa12bb6944f9c34aef3b3372b03abdf2234ff530d850a5738/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/963bfa849aa746e26948050f4a785acb340747497899327635a9b62658c1255d/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/9d9dad909b025571811f40c34c306c05182514a09159f34d360076c261a4f14f/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-410:{mountpoint:/var/lib/containers/storage/overlay/d987d8611b085094ae6b0e1302dd39e208c0fe87a09123dd9ad5c19769af6fa5/merged major:0 minor:410 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/76c83ee641b58d1e63bee4ded6cc78372b0e9cea832bfcfb3450ec7dc45871a7/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/fd23d288febf61d2bf33b0778acdf1eae5cb2160baf45f5d6725cd1d9069b4c5/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/e6e5edb205078b2cacb743d7fdf78d83b4533d3f291b36ec8223c1ad4eceaeb2/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/c5d658bd586f0abd63137372be74aa82775c7060393ca1525ebd04e501bf6904/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-454:{mountpoint:/var/lib/containers/storage/overlay/ee15853544e04b5373c2942517aca839ae097fd8c92c155ef7f7aa00c54282a2/merged major:0 minor:454 fsType:overlay blockSize:0} overlay_0-456:{mountpoint:/var/lib/containers/storage/overlay/a460dc6bd4177b48f37975a09a054033454e6bb458329134e080e10f6f7db01e/merged major:0 minor:456 fsType:overlay blockSize:0} overlay_0-461:{mountpoint:/var/lib/containers/storage/overlay/4e5ac5a0aaba4453addce1f136b572e6705dd1b156360e0bd955e29be511c8ee/merged major:0 minor:461 fsType:overlay blockSize:0} overlay_0-468:{mountpoint:/var/lib/containers/storage/overlay/c029983ef4e30326cda5321dd72e4e837d7bba4e357173b95ed4640b0c730f38/merged major:0 minor:468 fsType:overlay blockSize:0} overlay_0-473:{mountpoint:/var/lib/containers/storage/overlay/1788d307c9d4c7b61b85977c6ed0587d358e531d2cf743a2c9bb04dfe62dbdc9/merged major:0 minor:473 fsType:overlay blockSize:0} overlay_0-478:{mountpoint:/var/lib/containers/storage/overlay/3198b2e2e46e3632b88c6509d5b61bc9dd645f8b0216439662523dfd089e0eba/merged major:0 minor:478 fsType:overlay blockSize:0} overlay_0-483:{mountpoint:/var/lib/containers/storage/overlay/cb1e2846822cb896bb5ef148383ba3c8473f2e0e992cd5a2b07fee0232e033d3/merged major:0 minor:483 fsType:overlay blockSize:0} overlay_0-486:{mountpoint:/var/lib/containers/storage/overlay/81298ae79763aea25c54269ac32b9e0ab00fdc57b96c54c8b08ec7aa27c82dd3/merged major:0 minor:486 fsType:overlay blockSize:0} overlay_0-491:{mountpoint:/var/lib/containers/storage/overlay/4f8e63a95d6ed5bbf0fa0c990466c1a471ed6b0fa92a1686ff9939821fb11031/merged major:0 minor:491 fsType:overlay blockSize:0} overlay_0-496:{mountpoint:/var/lib/containers/storage/overlay/a0caa7d1e732730e9a444e7666f190a6978337ab62f362d060a9e5ba14b01af7/merged major:0 minor:496 fsType:overlay blockSize:0} overlay_0-501:{mountpoint:/var/lib/containers/storage/overlay/652e2a402ee3b11fed8022fd5c194ffab828ad48270da8713666605261f102df/merged major:0 minor:501 fsType:overlay blockSize:0} overlay_0-506:{mountpoint:/var/lib/containers/storage/overlay/0e6d1f376f4ed950cd2cd7cc7bdbffed2b13eb727630d3e1a10930ecfb041003/merged major:0 minor:506 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/3bab93576c804948cd1421ca30529874601c2f8f7cf21269c100b169182f304c/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-519:{mountpoint:/var/lib/containers/storage/overlay/079ac696ac2c979dc3097493cc63e848fa9846b4a5ca5a4b3ab60a184c287498/merged major:0 minor:519 fsType:overlay blockSize:0} overlay_0-521:{mountpoint:/var/lib/containers/storage/overlay/978b57cb12b5c7512bfab02d9558eb64445923e1c6caa4e83eab93dff5cf1ef2/merged major:0 minor:521 fsType:overlay blockSize:0} overlay_0-523:{mountpoint:/var/lib/containers/storage/overlay/fdc11c871e7882335457aaebe0ebf31a20a61dac0282f1c54aac1618f0ed59ce/merged major:0 minor:523 fsType:overlay blockSize:0} overlay_0-529:{mountpoint:/var/lib/containers/storage/overlay/276594f62ee43a9bcc9160f8240c31964e41427c47e3f5623e8893bf0a8e539f/merged major:0 minor:529 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/2f98d8433f985d25bfbaff292b26b19e927526ba05c1b297ef86050b25f1692c/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-535:{mountpoint:/var/lib/containers/storage/overlay/2a5d0fba1be13bd638bb42c5b01b773b713b3decb858f5cd24e88af3bb40686f/merged major:0 minor:535 fsType:overlay blockSize:0} overlay_0-540:{mountpoint:/var/lib/containers/storage/overlay/62ad31c24faa00b403ee242d3d2f2f69e7566ff24cf3cf8863c93166305ad697/merged major:0 minor:540 fsType:overlay blockSize:0} overlay_0-545:{mountpoint:/var/lib/containers/storage/overlay/0deaf555a720470036d9eb03f3f8e7b1f0993f472219bcd742df22ebba714eab/merged major:0 minor:545 fsType:overlay blockSize:0} overlay_0-550:{mountpoint:/var/lib/containers/storage/overlay/f45d2b30c80ccb5035b80eb7f50cd96905d997042e86966df6f6793f09c69a2d/merged major:0 minor:550 fsType:overlay blockSize:0} overlay_0-564:{mountpoint:/var/lib/containers/storage/overlay/72b7e034b2811bce7fc0485dc7b65b141eeedfa871e5c609fb3fa027f474960f/merged major:0 minor:564 fsType:overlay blockSize:0} overlay_0-566:{mountpoint:/var/lib/containers/storage/overlay/885266da5b643c684697e15459a068dafb123bde0fdaf9234cb2e99243c247e6/merged major:0 minor:566 fsType:overlay blockSize:0} overlay_0-568:{mountpoint:/var/lib/containers/storage/overlay/31f96110c59c912b5485077cf02a02542400e873fc56762d8953301de7b9f885/merged major:0 minor:568 fsType:overlay blockSize:0} overlay_0-570:{mountpoint:/var/lib/containers/storage/overlay/eb47c659fe51eb6c05a565c1c7c56ee6f2782332eeb555e61a556e901dae8193/merged major:0 minor:570 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/50e8de2774829880706818fe390d14103c8ff3325a58f1bbf3704559d0c53e45/merged major:0 min
Oct 31 00:29:55.699950 ip-10-0-143-57 kubenswrapper[7559]: or:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/434a43d5461ef19bb9bbd32566270b0ae969feaf4bceb3930edeeb85f60d5002/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/f7fa6b96b89d77170c880a8b056e634c5b9596b77bfb24a2e189bfefa655fcc0/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/02f113366b32beeabf03de44721c6bd091830adca65fa2324513f17f541d23bf/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/5fa5cbe30e1071b8e45469e6ac9b50725dfc462754a81cdac15477c5f1d08479/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/0ce24af01392042a18875a079db69daafb91f05882582ac3d44c62be914c6973/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/2f661d2824765fa71f5d5ca361e5947e3ce90ceee2c2926e8197956c537794e7/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-97:{mountpoint:/var/lib/containers/storage/overlay/87f2b9b55531ff4c6a0dfb2226a7da3ad236a2f573f2b0a33baeca042666c3ef/merged major:0 minor:97 fsType:overlay blockSize:0}]
Oct 31 00:29:55.700262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.699741    7559 manager.go:217] Machine: {Timestamp:2026-10-31 00:29:55.699220917 +0000 UTC m=+0.074116130 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104547 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da62a910568aa63c0309cb3bc0c7a SystemUUID:ec2da62a-9105-68aa-63c0-309cb3bc0c7a BootID:eaadee93-d039-4d89-87f0-512f4d651297 Filesystems:[{Device:/run/containers/storage/overlay-containers/98cb77d9d8e14599ba84d023b3c6ab155dc5832d62527885605eff691538c987/userdata/shm DeviceMajor:0 DeviceMinor:387 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:451 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/53fb995c40737bf4e711743b1833c6e9b99d132776203bfa7874a4940833d702/userdata/shm DeviceMajor:0 DeviceMinor:560 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68b9a0426a4395e9636e05cf0b8f60b919f842a2a06c6d33b8975b2449c962c1/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/kube-api-access-6px58 DeviceMajor:0 DeviceMinor:342 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:349 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-550 DeviceMajor:0 DeviceMinor:550 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:203 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-238 DeviceMajor:0 DeviceMinor:238 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:405 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-491 DeviceMajor:0 DeviceMinor:491 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:224 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~projected/kube-api-access-kbrxk DeviceMajor:0 DeviceMinor:397 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-461 DeviceMajor:0 DeviceMinor:461 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:443 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:202 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:338 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:333 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~projected/kube-api-access-wp2vx DeviceMajor:0 DeviceMinor:386 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:201 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:336 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:343 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:443 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-496 DeviceMajor:0 DeviceMinor:496 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca60a2b2ba28375271f23954c3c58b500e19b0aa5d1e79c8be68f2e02e2b8e9b/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:347 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-564 DeviceMajor:0 DeviceMinor:564 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cbec678a02c0d64ef52652f8b0d60cecbfe74e1625db68c7a6fb9c2fb3cf1eb/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:298 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:337 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:406 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-535 DeviceMajor:0 DeviceMinor:535 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cdc3eead-3ad0-46f2-b545-ec15921a2ab5/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~projected/kube-api-access-4jxvr DeviceMajor:0 DeviceMinor:65 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-151 DeviceMajor:0 DeviceMinor:151 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1dd6c257acdaf1920bf38c3af589c428f79cf10d027a1c05e5ee8582be912cb/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~projected/kube-api-access-qm29s DeviceMajor:0 DeviceMinor:516 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-540 DeviceMajor:0 DeviceMinor:540 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b35bd97d50f8ceaa7dfc0fe435f315a5b6254396cdba25b179dfafa7e70852b/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ae10dc7920b195bdd4edf64a01dd3cc9f989215874c4e997b4850bf3eca9dd2f/userdata/shm DeviceMajor:0 DeviceMinor:312 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:334 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:336 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0/userdata/shm DeviceMajor:0 DeviceMinor:465 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-473 DeviceMajor:0 DeviceMinor:473 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-501 DeviceMajor:0 DeviceMinor:501 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a21b4377-105b-4b2f-a7a5-d93dc6f9be39/volumes/kubernetes.io~projected/kube-api-access-7qv86 DeviceMajor:0 DeviceMinor:559 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-568 DeviceMajor:0 DeviceMinor:568 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:293 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:341 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:348 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:441 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/5da59575-dc74-4cda-9e57-b9437c54dbd7/volumes/kubernetes.io~projected/kube-api-access-clwjl DeviceMajor:0 DeviceMinor:67 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:302 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:389 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:450 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:453 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/8c7eb1ae-0643-472e-a33c-4c7c3b88a266/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:555 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e0b7efcc63380b1bbee447b45d88e5a7928d2cf35a8b5e2c0c2cba3ad2f777a/userdata/shm DeviceMajor:0 DeviceMinor:300 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:331 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3dc7d36a856c1706fb914d14ad26c592827c4d471b29b08f3abf902a7386d91/userdata/shm DeviceMajor:0 DeviceMinor:561 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/72bc206e-b599-4c37-bb62-9c2d7047a85d/volumes/kubernetes.io~projected/kube-api-access-8gqcb DeviceMajor:0 DeviceMinor:208 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/369333e6b4c6990b1c462cfc6fcde4fe324781fb99abdcd66b258206f219a5d1/userdata/shm DeviceMajor:0 DeviceMinor:395 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c/userdata/shm DeviceMajor:0 DeviceMinor:517 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ae2b5f4ecfb4d4e0390b05a0743f75eed81fe33fecd943935d01875cd8b60f2e/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~projected/kube-api-access-5pq6m DeviceMajor:0 DeviceMinor:207 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~projected/kube-api-access-5v6kh DeviceMajor:0 DeviceMinor:307 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~projected/kube-api-access-dql9q DeviceMajor:0 DeviceMinor:392 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:452 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2772c7637c436f28e74d8bf08eca7b544493eeb9b4065247786b861ce7a90e0/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:339 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:390 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/7f8186db-5274-46ad-942c-6aca4b1d1686/volumes/kubernetes.io~projected/kube-api-access-dxj7h DeviceMajor:0 DeviceMinor:64 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be25a47117e64018958fdcb432d227c9c974cd049965493d1a79e8f174141bd4/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/afc0424f99f8e792112a8545a2a9e3b5782cecddc500e4e90e90c81b097fe675/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:404 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:439 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:443 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/01d0107ad8129b052f668c5bbb241abc2f37c20c31f850983598b1ee5b5ca998/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~projected/kube-api-access-4q629 DeviceMajor:0 DeviceMinor:306 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-454 DeviceMajor:0 DeviceMinor:454 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-456 DeviceMajor:0 DeviceMinor:456 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-486 DeviceMajor:0 DeviceMinor:486 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-506 DeviceMajor:0 DeviceMinor:506 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~projected/kube-api-access-dmmvp DeviceMajor:0 DeviceMinor:62 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:332 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:335 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5a4bd546caaaf8b55a1935f83148c84ee22714d735af353e665e4b1073dd797e/userdata/shm DeviceMajor:0 DeviceMinor:210 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:340 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414/userdata/shm DeviceMajor:0 DeviceMinor:350 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:338 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:511 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-519 DeviceMajor:0 DeviceMinor:519 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-523 DeviceMajor:0 DeviceMinor:523 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03241bf1-5cee-42ff-90cf-d3ae59a39fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:304 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/8bcc5163-4382-4160-b05b-b6f745faafdb/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:305 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/cf645cc8-1325-4315-94b3-470599cf28e8/volumes/kubernetes.io~projected/kube-api-access-6vgr7 DeviceMajor:0 DeviceMinor:352 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-529 DeviceMajor:0 DeviceMinor:529 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6e919594-7e7d-413f-a997-80a2b9780006/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a2f325f0-14b6-4849-9db1-1def3092575f/volumes/kubernetes.io~projected/kube-api-access-cxh5j DeviceMajor:0 DeviceMinor:63 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:204 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~projected/kube-api-access-rtdtb DeviceMajor:0 DeviceMinor:232 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d8dea89c2f2028aea3edd0cd9d430039923b11996a7b30b752119f34183a9d4/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/8bff60fc-622d-4b2d-a935-537b4e9c3ae2/volumes/kubernetes.io~projected/kube-api-access-mpp55 DeviceMajor:0 DeviceMinor:299 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/611b4aab-bbce-4c31-8074-f79ff52f2cd1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:303 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-478 DeviceMajor:0 DeviceMinor:478 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:515 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac9ca7b97f09615d46f6de5c423bb4d6649d84ce383949ac5ff67c04a7c23f0d/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-240 DeviceMajor:0 DeviceMinor:240 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:385 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:336 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e/volumes/kubernetes.io~projected/kube-api-access-cgclh DeviceMajor:0 DeviceMinor:59 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a5017bbe07c4354e8e32c1bce6881089c0e86ac0be0af956cba205acd6a9bfd9/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-97 DeviceMajor:0 DeviceMinor:97 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~projected/kube-api-access-hzg6t DeviceMajor:0 DeviceMinor:197 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f879d1a1c1e0f4df88d5e8530421308f0673a3574aa1098b095782d1a0d836af/userdata/shm DeviceMajor:0 DeviceMinor:398 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~projected/kube-api-access-6sp59 DeviceMajor:0 DeviceMinor:438 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:235 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:336 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/77822f8f-dc1d-4774-99dd-673286558e56/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:399 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-468 DeviceMajor:0 DeviceMinor:468 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-521 DeviceMajor:0 DeviceMinor:521 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-545 DeviceMajor:0 DeviceMinor:545 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/639d9b02-4e18-4090-905b-8ca6d4d8352a/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:391 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:448 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-483 DeviceMajor:0 DeviceMinor:483 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:443 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-570 DeviceMajor:0 DeviceMinor:570 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1927717c-0969-4669-85cf-da2c7d741f42/volumes/kubernetes.io~projected/kube-api-access-wfgdz DeviceMajor:0 DeviceMinor:60 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/751d219a-41af-4a6e-9eaf-25879c685574/volumes/kubernetes.io~projected/kube-api-access-x58n4 DeviceMajor:0 DeviceMinor:66 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/198c39d2-beca-4447-abeb-3b57050cb3f6/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:449 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/3a7c0204-7117-4e6e-b910-953890e7d582/volumes/kubernetes.io~projected/kube-api-access-cwdz8 DeviceMajor:0 DeviceMinor:61 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-410 DeviceMajor:0 DeviceMinor:410 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:440 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:442 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f8f3537e-25dc-4592-83c7-795b5f1d8af0/volumes/kubernetes.io~projected/kube-api-access-ztw7g DeviceMajor:0 DeviceMinor:206 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-566 DeviceMajor:0 DeviceMinor:566 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d8d3e52d94729fecdeb5aa5e5f140c1012c67796a886eff14fef17f96c989b60/userdata/shm DeviceMajor:0 DeviceMinor:317 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:229 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:01d0107ad8129b0 MacAddress:da:2c:77:c7:b6:65 Speed:10000 Mtu:8901} {Name:369333e6b4c6990 MacAddress:de:3b:3d:32:45:29 Speed:10000 Mtu:8901} {Name:4e0b7efcc63380b MacAddress:ba:73:58:d9:0b:60 Speed:10000 Mtu:8901} {Name:53fb995c40737bf MacAddress:52:d6:b2:80:bd:49 Speed:10000 Mtu:8901} {Name:56d9a8c3b898c11 MacAddress:82:ec:24:c5:ce:57 Speed:10000 Mtu:8901} {Name:5a4bd546caaaf8b MacAddress:62:04:57:f9:c2:e6 Speed:10000 Mtu:8901} {Name:98cb77d9d8e1459 MacAddress:e6:83:07:1e:32:05 Speed:10000 Mtu:8901} {Name:9a65a9de3e08dcc MacAddress:96:c2:e5:fb:cf:7f Speed:10000 Mtu:8901} {Name:a759b72b86b3297 MacAddress:46:b7:d5:74:fa:2c Speed:10000 Mtu:8901} {Name:ac9ca7b97f09615 MacAddress:e6:7d:eb:e5:e6:37 Speed:10000 Mtu:8901} {Name:afc0424f99f8e79 MacAddress:46:50:31:aa:c1:ce Speed:10000 Mtu:8901} {Name:baf6d1ffae4508b MacAddress:9e:96:6d:69:57:88 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:f4:69:0a:eb Speed:0 Mtu:9001} {Name:br-int MacAddress:ee:1b:27:c2:23:a3 Speed:0 Mtu:8901} {Name:c2772c7637c436f MacAddress:02:47:bd:85:94:86 Speed:10000 Mtu:8901} {Name:d1dd6c257acdaf1 MacAddress:fe:6a:2d:8c:9e:3d Speed:10000 Mtu:8901} {Name:d3dc7d36a856c17 MacAddress:7a:c7:12:d6:cb:29 Speed:10000 Mtu:8901} {Name:d8d3e52d94729fe MacAddress:96:c7:b7:28:e9:48 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:f4:69:0a:eb Speed:0 Mtu:9001} {Name:f879d1a1c1e0f4d MacAddress:56:0d:c7:ad:7b:4d Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:32:0e:55:df:2f:fa Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ae:0b:cd:ca:ad:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:29:55.700262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700267    7559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:29:55.700637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700311    7559 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:29:55.700637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700619    7559 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:29:55.700787 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700641    7559 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-57.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:29:55.700839 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700789    7559 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:29:55.700839 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700798    7559 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:29:55.700839 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700809    7559 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:29:55.700839 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700829    7559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:29:55.700943 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.700919    7559 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:29:55.701078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701068    7559 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:29:55.701201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701192    7559 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:29:55.701250 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701240    7559 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:29:55.701278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701256    7559 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:29:55.701278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701266    7559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:29:55.701278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701277    7559 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:29:55.701389 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.701286    7559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:29:55.703534 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.703389    7559 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:29:55.703534 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.703407    7559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:29:55.704092 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.704068    7559 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:29:55.708875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708375    7559 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:29:55.708875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708393    7559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:29:55.708875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708513    7559 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 00:29:55.708875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708784    7559 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:29:55.708875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708825    7559 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708937    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708954    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708963    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708971    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708981    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708989    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.708998    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709006    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709017    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709026    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709044    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709057    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709087    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.709095    7559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.714305    7559 server.go:1263] "Started kubelet"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.716887    7559 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.717999    7559 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.722277    7559 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.722473    7559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.722539    7559 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.722825    7559 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.723036    7559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.724808    7559 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.724822    7559 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.724898    7559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728157    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2f325f0-14b6-4849-9db1-1def3092575f" volumeName="kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728190    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728202    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728213    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dafad05c-abe0-4a45-a8f4-b3ffb5aaf055" volumeName="kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728225    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728235    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="198c39d2-beca-4447-abeb-3b57050cb3f6" volumeName="kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728246    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728257    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728269    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728280    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728291    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8f3537e-25dc-4592-83c7-795b5f1d8af0" volumeName="kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728301    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728311    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1927717c-0969-4669-85cf-da2c7d741f42" volumeName="kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728321    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728339    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728349    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728361    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bff60fc-622d-4b2d-a935-537b4e9c3ae2" volumeName="kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728371    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728383    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="198c39d2-beca-4447-abeb-3b57050cb3f6" volumeName="kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728394    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a7c0204-7117-4e6e-b910-953890e7d582" volumeName="kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728405    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728415    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728427    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="198c39d2-beca-4447-abeb-3b57050cb3f6" volumeName="kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728437    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e919594-7e7d-413f-a997-80a2b9780006" volumeName="kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728447    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728457    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdc3eead-3ad0-46f2-b545-ec15921a2ab5" volumeName="kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728467    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dafad05c-abe0-4a45-a8f4-b3ffb5aaf055" volumeName="kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728477    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728493    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72bc206e-b599-4c37-bb62-9c2d7047a85d" volumeName="kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728503    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728515    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728525    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728534    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728546    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03241bf1-5cee-42ff-90cf-d3ae59a39fae" volumeName="kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728557    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5da59575-dc74-4cda-9e57-b9437c54dbd7" volumeName="kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728569    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728579    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728590    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dafad05c-abe0-4a45-a8f4-b3ffb5aaf055" volumeName="kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728619    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e919594-7e7d-413f-a997-80a2b9780006" volumeName="kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728631    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728644    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03241bf1-5cee-42ff-90cf-d3ae59a39fae" volumeName="kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728655    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728668    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728679    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72bc206e-b599-4c37-bb62-9c2d7047a85d" volumeName="kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728690    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728701    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728713    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728723    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728734    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f8186db-5274-46ad-942c-6aca4b1d1686" volumeName="kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728745    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a21b4377-105b-4b2f-a7a5-d93dc6f9be39" volumeName="kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728756    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5da59575-dc74-4cda-9e57-b9437c54dbd7" volumeName="kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728767    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2f325f0-14b6-4849-9db1-1def3092575f" volumeName="kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728778    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728789    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728800    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbff7817-a278-44aa-bb7d-5aacdbf7d4ac" volumeName="kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728810    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728829    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728839    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728851    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728862    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03241bf1-5cee-42ff-90cf-d3ae59a39fae" volumeName="kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728872    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728884    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728950    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8f3537e-25dc-4592-83c7-795b5f1d8af0" volumeName="kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728962    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8f3537e-25dc-4592-83c7-795b5f1d8af0" volumeName="kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728973    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728984    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.728996    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729005    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729020    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729031    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729043    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bff60fc-622d-4b2d-a935-537b4e9c3ae2" volumeName="kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729053    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c7eb1ae-0643-472e-a33c-4c7c3b88a266" volumeName="kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729064    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2f325f0-14b6-4849-9db1-1def3092575f" volumeName="kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729075    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729085    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729095    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729106    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729116    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bff60fc-622d-4b2d-a935-537b4e9c3ae2" volumeName="kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729127    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729138    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dafad05c-abe0-4a45-a8f4-b3ffb5aaf055" volumeName="kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729149    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1927717c-0969-4669-85cf-da2c7d741f42" volumeName="kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729160    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729172    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729183    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729193    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729203    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729213    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729224    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729235    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729245    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729256    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e" volumeName="kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729266    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729276    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729286    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="198c39d2-beca-4447-abeb-3b57050cb3f6" volumeName="kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729298    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729308    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729318    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729339    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bff60fc-622d-4b2d-a935-537b4e9c3ae2" volumeName="kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729349    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729359    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03241bf1-5cee-42ff-90cf-d3ae59a39fae" volumeName="kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729381    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729392    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2f325f0-14b6-4849-9db1-1def3092575f" volumeName="kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729403    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729413    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729424    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729435    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729449    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8f3537e-25dc-4592-83c7-795b5f1d8af0" volumeName="kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729459    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 31 00:29:55.729978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729470    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e919594-7e7d-413f-a997-80a2b9780006" volumeName="kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.729480    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.732984    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="751d219a-41af-4a6e-9eaf-25879c685574" volumeName="kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733014    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733076    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdc3eead-3ad0-46f2-b545-ec15921a2ab5" volumeName="kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733192    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="751d219a-41af-4a6e-9eaf-25879c685574" volumeName="kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733204    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733220    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5da59575-dc74-4cda-9e57-b9437c54dbd7" volumeName="kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733232    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733249    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f8186db-5274-46ad-942c-6aca4b1d1686" volumeName="kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733262    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbff7817-a278-44aa-bb7d-5aacdbf7d4ac" volumeName="kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733275    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a7c0204-7117-4e6e-b910-953890e7d582" volumeName="kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733291    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733303    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71604ceb-556f-4409-bf6b-732a6e6196a0" volumeName="kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733451    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af81ff8e-3a14-417d-9bd9-705389fb906b" volumeName="kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733464    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf645cc8-1325-4315-94b3-470599cf28e8" volumeName="kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733478    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03241bf1-5cee-42ff-90cf-d3ae59a39fae" volumeName="kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733494    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bcc5163-4382-4160-b05b-b6f745faafdb" volumeName="kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733507    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733522    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733531    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bae86b63-5c86-4f8b-92eb-b069c6412c5a" volumeName="kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733541    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07275759-29b2-4d6d-8c25-9e80e907d310" volumeName="kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733553    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="611b4aab-bbce-4c31-8074-f79ff52f2cd1" volumeName="kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733562    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="639d9b02-4e18-4090-905b-8ca6d4d8352a" volumeName="kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733682    7559 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77822f8f-dc1d-4774-99dd-673286558e56" volumeName="kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733696    7559 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.733704    7559 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.734358    7559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:23:45 +0000 UTC" deadline="2028-06-23 06:01:19.24070429 +0000 UTC"
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.734393    7559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14429h31m23.506313971s"
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.737757    7559 factory.go:55] Registering systemd factory
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.737777    7559 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:29:55.741877 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.737894    7559 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:29:55.735209 ip-10-0-143-57 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742020    7559 factory.go:153] Registering CRI-O factory
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742042    7559 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742341    7559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742379    7559 factory.go:103] Registering Raw factory
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742398    7559 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:29:55.743359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.742791    7559 manager.go:319] Starting recovery of all containers
Oct 31 00:29:55.756635 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.756565    7559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:29:55.772364 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.772333    7559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:29:55.772364 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.772362    7559 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:29:55.772564 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.772386    7559 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:29:55.772564 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.772431    7559 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 00:29:55.785218 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.785177    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881" exitCode=0
Oct 31 00:29:55.798468 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.798434    7559 generic.go:356] "Generic (PLEG): container finished" podID="8bcc5163-4382-4160-b05b-b6f745faafdb" containerID="ff73a8c6fa6c3a34a9a69dd3889fa1f86b8231619b23d5b77ba7f92a125b696d" exitCode=0
Oct 31 00:29:55.808762 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.808734    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c" exitCode=0
Oct 31 00:29:55.816331 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816300    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="e78d189b82f46e7c55a2766431095b7cbff71b1c768455c506e55a6ff3ea5473" exitCode=0
Oct 31 00:29:55.816331 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816327    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="c2874ece11c2751f4a129307c4f2ebea809649dcf4be4642662cdc4343276c67" exitCode=0
Oct 31 00:29:55.816331 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816338    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="2fe5f2eb32d4c1a36964228905eda50d2d96f240aa6cd568055dec650696211a" exitCode=0
Oct 31 00:29:55.816579 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816349    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="b4c156aa8bf8cc93f1b45925868e6c7c58bfc7f491aa0a4d0bc6f4c822e3df69" exitCode=0
Oct 31 00:29:55.816579 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816357    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="a2c8140daee7394930f90a267dd61432422e47c61e4d7b3d9b87ad9442518ec2" exitCode=0
Oct 31 00:29:55.816579 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.816364    7559 generic.go:356] "Generic (PLEG): container finished" podID="a2f325f0-14b6-4849-9db1-1def3092575f" containerID="6740fb42b3fb36e8f60947e900a03b9aeaf587f45201bc5e799a17b0089d7cc9" exitCode=0
Oct 31 00:29:55.838207 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.838172    7559 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-57.us-west-2.compute.internal\" not found"
Oct 31 00:29:55.841024 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.840989    7559 generic.go:356] "Generic (PLEG): container finished" podID="f65a546c5c81725b0e0154a92190770e" containerID="09f319b523ddcf98568d5aa128d04b1303fec19bee5519058c15b36e624b0f49" exitCode=0
Oct 31 00:29:55.872515 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.872480    7559 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 31 00:29:55.874556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.874535    7559 manager.go:324] Recovery completed
Oct 31 00:29:55.898635 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.898608    7559 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:29:55.901196 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.901175    7559 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:29:55.901263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.901186    7559 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:29:55.901263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.901203    7559 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 00:29:55.903026 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.903009    7559 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:29:55.904764 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.904748    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:29:55.904836 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.904777    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:29:55.904836 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.904790    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.908853    7559 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.908880    7559 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.908903    7559 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909202    7559 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909218    7559 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909242    7559 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909251    7559 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909259    7559 policy_none.go:50] "Start"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909283    7559 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909296    7559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909536    7559 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909547    7559 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 00:29:55.909650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.909555    7559 policy_none.go:44] "Start"
Oct 31 00:29:55.915003 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.914949    7559 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:29:55.919823 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.919809    7559 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:29:55.919899 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.919843    7559 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:29:55.919899 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.919854    7559 server.go:87] "Starting device plugin registration server"
Oct 31 00:29:55.920131 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920120    7559 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:29:55.920168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920132    7559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:29:55.920242 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920225    7559 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:29:55.920351 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920325    7559 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:29:55.920423 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920357    7559 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:29:55.920423 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920362    7559 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:29:55.920988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.920919    7559 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:29:55.920348646Z","UUID":"ec0e597b-5113-413a-aa85-4396b7565fe3","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:29:55.922143 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.922126    7559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:29:55.922243 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:55.922187    7559 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:29:55.922457 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.922192    7559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:29:55.993835 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:55.993807    7559 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:29:56.020447 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.020422    7559 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:29:56.021490 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.021475    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:29:56.021546 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.021504    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:29:56.021546 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.021513    7559 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-57.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:29:56.021619 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.021583    7559 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.073492 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.073443    7559 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"]
Oct 31 00:29:56.074220 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074170    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"5a29509a616f19d20041e78e9796eaef","Type":"ContainerStarted","Data":"a3c851f3bcb7f71c9fe4a56cbd5c658a372eba7515dacd1ce6a78614938380b2"}
Oct 31 00:29:56.074220 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074200    7559 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.074362 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074335    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"5a29509a616f19d20041e78e9796eaef","Type":"ContainerStarted","Data":"522bfc0af614334a925db50192671ef1d959ba24762e9119177862c502feb56d"}
Oct 31 00:29:56.074535 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074522    7559 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.074567 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074531    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerStarted","Data":"2ed579aa209bce48c3d3fa60d23f9c5ce9568ab96deb7b164571afe7b05d6895"}
Oct 31 00:29:56.074567 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074557    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerDied","Data":"09f319b523ddcf98568d5aa128d04b1303fec19bee5519058c15b36e624b0f49"}
Oct 31 00:29:56.074703 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.074576    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal" event={"ID":"f65a546c5c81725b0e0154a92190770e","Type":"ContainerStarted","Data":"cada1d0a8f04c2eeec494b87d83664734cab737aec948459941563c5e5b20abf"}
Oct 31 00:29:56.131636 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.131590    7559 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.131751 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.131691    7559 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.134111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.134092    7559 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:29:56.134202 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:56.134135    7559 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.135756 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.135744    7559 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:29:56.135795 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:56.135783    7559 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.202357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.202240    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.202357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.202322    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.202357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.202339    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302750 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302712    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302750 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302748    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302769    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302819    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302830    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f65a546c5c81725b0e0154a92190770e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"f65a546c5c81725b0e0154a92190770e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.302923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.302882    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a29509a616f19d20041e78e9796eaef-config\") pod \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" (UID: \"5a29509a616f19d20041e78e9796eaef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.701637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.701585    7559 apiserver.go:52] "Watching apiserver"
Oct 31 00:29:56.847848 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.847815    7559 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:29:56.848679 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.848655    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tpc6d","openshift-network-operator/iptables-alerter-fwgw5","openshift-ingress-canary/ingress-canary-mmb5b","openshift-multus/multus-22sgf","openshift-monitoring/telemeter-client-566b5dddf-4lwr4","openshift-multus/multus-additional-cni-plugins-2zp84","openshift-monitoring/prometheus-k8s-0","openshift-console/console-78b57f57c9-zpb6f","openshift-monitoring/thanos-querier-554698664c-x6vzb","openshift-dns/dns-default-hz4np","openshift-monitoring/monitoring-plugin-77f4f76594-w72zc","openshift-ovn-kubernetes/ovnkube-node-r8ml2","openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2","openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4","openshift-monitoring/metrics-server-767548898d-bt8ls","openshift-monitoring/alertmanager-main-0","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal","openshift-network-diagnostics/network-check-target-lfth8","openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl","openshift-multus/network-metrics-daemon-xltzg","openshift-console/console-5696d45945-njv6j","openshift-insights/insights-runtime-extractor-dggrt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm","openshift-cluster-node-tuning-operator/tuned-8nwg8","kube-system/konnectivity-agent-g7bh6","openshift-image-registry/node-ca-j4sq6","openshift-monitoring/node-exporter-jwdtq","openshift-dns/node-resolver-w9tkj"]
Oct 31 00:29:56.852723 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.852702    7559 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.852860 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.852845    7559 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.900696 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.900655    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:29:56.900888 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.900841    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzctz\""
Oct 31 00:29:56.900888 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.900855    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9b4md\""
Oct 31 00:29:56.901004 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.900986    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4l8km\""
Oct 31 00:29:56.901068 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.900989    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8m77\""
Oct 31 00:29:56.901068 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.901043    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bv698\""
Oct 31 00:29:56.901979 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.901957    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.902094 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902033    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.902142 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902123    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.902142 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902131    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902140    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902172    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902182    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902214    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902215    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:29:56.902245 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902233    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.902495 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.902435    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.928367 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.928346    7559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:29:56.942730 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.942712    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:29:56.943651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943629    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.943772 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943727    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.943840 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943787    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:29:56.943894 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943866    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.944016 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943897    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:29:56.944016 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.943992    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.944117 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.944062    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:29:56.944117 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.944099    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:29:56.944698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.944685    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:29:56.944892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.944881    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.947370 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947356    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.947370 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947365    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:29:56.947473 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947402    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:29:56.947473 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947436    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-2sfqr\""
Oct 31 00:29:56.947473 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947440    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6xpx\""
Oct 31 00:29:56.947685 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947670    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prxzz\""
Oct 31 00:29:56.947767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947732    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:29:56.947767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947741    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.947767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947764    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:29:56.947894 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947803    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.947894 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947802    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.947988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947934    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:29:56.947988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.947972    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.948129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948115    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 00:29:56.948187 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948131    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:29:56.948187 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948157    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:29:56.948289 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948217    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:29:56.948289 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948219    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:29:56.948289 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948265    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 00:29:56.948419 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.948322    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6z87r\""
Oct 31 00:29:56.949081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949065    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-klgwd\""
Oct 31 00:29:56.949171 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949099    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:29:56.949424 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949404    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 00:29:56.949424 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949418    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:29:56.949557 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949455    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 00:29:56.949557 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949494    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzhm5\""
Oct 31 00:29:56.949660 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949633    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:29:56.949823 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949804    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m9htb\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949807    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-skrl7\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949842    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949853    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949814    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s5c24\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949840    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vb9k\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949881    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:29:56.949892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949868    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mqw2c\""
Oct 31 00:29:56.950129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949882    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:29:56.950129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949918    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-5b488\""
Oct 31 00:29:56.950129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949921    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-bpzsc\""
Oct 31 00:29:56.950129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.949956    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cbfrg\""
Oct 31 00:29:56.950291 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.950271    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:29:56.958151 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.958099    7559 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:29:56.958218 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:56.958152    7559 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:56.959582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:56.959568    7559 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:29:56.959648 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:29:56.959618    7559 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 00:29:57.001707 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.001666    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 31 00:29:57.001707 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.001691    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 00:29:57.001707 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.001694    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 00:29:57.001930 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.001760    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 00:29:57.002208 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002187    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:29:57.002281 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002216    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:29:57.002281 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002231    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:29:57.002281 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002195    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:29:57.002281 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002239    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:29:57.002501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002301    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 00:29:57.002501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002325    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 31 00:29:57.002501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002411    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 00:29:57.002501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002466    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 31 00:29:57.002501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002477    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 00:29:57.002769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002488    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 31 00:29:57.002769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002554    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 31 00:29:57.002769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002658    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 31 00:29:57.002944 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.002929    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fs297cs649aha\""
Oct 31 00:29:57.003014 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003000    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-958gj\""
Oct 31 00:29:57.003067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003016    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:29:57.003067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003053    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:29:57.003067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003059    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6cj6h\""
Oct 31 00:29:57.003208 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003193    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 00:29:57.003269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003205    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 31 00:29:57.003269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003227    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 31 00:29:57.003269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003241    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 31 00:29:57.003269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003258    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 00:29:57.003269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003263    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 31 00:29:57.003451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003244    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wlc7r\""
Oct 31 00:29:57.003451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003294    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:29:57.003451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003301    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 31 00:29:57.003451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003412    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 31 00:29:57.003451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003433    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003462    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003467    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003469    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bu2h4pj0qeqbr\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003485    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bx8qq\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003493    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003494    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003645    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003650    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003658    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tcw2z\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003655    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 31 00:29:57.003672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003677    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003689    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003721    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003734    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003739    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003750    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a8mpo1anopo2v\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003821    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jb528\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.003862    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 31 00:29:57.004093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.004073    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 31 00:29:57.004338 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.004160    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 31 00:29:57.004786 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.004768    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 00:29:57.004891 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.004809    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.005189    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cjt6r\""
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006501    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006537    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006573    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006627    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006661    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006692    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006718    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jxvr\" (UniqueName: \"kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006748    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006786    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006816    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006848    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006870    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006899    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006927    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006957    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxj7h\" (UniqueName: \"kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.006985    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007009    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007040    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007068    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007097    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007131    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007164    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007186    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007213    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007242    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007272    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007295    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007325    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007354    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007383    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007415    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007441    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007471    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pq6m\" (UniqueName: \"kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007499    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007531    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007563    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007592    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007641    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007674    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007704    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007734    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007766    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007791    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007818    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007849    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007882    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007913    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007942    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.007971    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008004    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6kh\" (UniqueName: \"kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008034    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008313    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008361    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008571    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.008724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008639    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.008972    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-daemon-config\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009100    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009113    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-tls\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009209    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bcc5163-4382-4160-b05b-b6f745faafdb-metrics-client-ca\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009402    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009438    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72bc206e-b599-4c37-bb62-9c2d7047a85d-cert\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009439    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009491    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009530    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009634    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-tmp\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009685    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-config\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009803    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-secret-metrics-server-client-certs\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009561    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639d9b02-4e18-4090-905b-8ca6d4d8352a-audit-log\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009830    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009905    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-federate-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009905    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009929    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009749    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5da59575-dc74-4cda-9e57-b9437c54dbd7-cni-binary-copy\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.009991    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovnkube-script-lib\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010036    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010054    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010095    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf645cc8-1325-4315-94b3-470599cf28e8-metrics-client-ca\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010101    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010114    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010186    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010307    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010345    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010359    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010441    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010501    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010496    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639d9b02-4e18-4090-905b-8ca6d4d8352a-client-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010523    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010545    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010563    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010566    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010576    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgdz\" (UniqueName: \"kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010683    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw7g\" (UniqueName: \"kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010748    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58n4\" (UniqueName: \"kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010901    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010932    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.010958    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011008    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg6t\" (UniqueName: \"kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011048    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011133    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011217    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011268    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdz8\" (UniqueName: \"kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011376    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011388    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011415    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.011395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011434    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011454    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011492    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011562    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011631    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011175    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011666    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198c39d2-beca-4447-abeb-3b57050cb3f6-config-volume\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011702    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011731    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011753    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011779    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwjl\" (UniqueName: \"kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011799    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011807    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03241bf1-5cee-42ff-90cf-d3ae59a39fae-env-overrides\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011820    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.011845    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012000    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqcb\" (UniqueName: \"kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012068    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8f3537e-25dc-4592-83c7-795b5f1d8af0-data-volume\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012169    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012212    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012233    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012251    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012259    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-metrics-server-audit-profiles\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012293    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012395    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012504    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q629\" (UniqueName: \"kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012507    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012530    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/611b4aab-bbce-4c31-8074-f79ff52f2cd1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012569    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012624    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012679    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012700    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012710    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf645cc8-1325-4315-94b3-470599cf28e8-tmp\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012720    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.012974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.012739    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013131    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013163    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013183    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql9q\" (UniqueName: \"kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013199    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013215    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013230    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013269    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03241bf1-5cee-42ff-90cf-d3ae59a39fae-ovn-node-metrics-cert\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013322    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013387    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013422    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013423    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013444    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013448    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013469    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013502    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013523    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013539    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgclh\" (UniqueName: \"kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013559    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013661    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-client-tls\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013668    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013697    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013712    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013726    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013752    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013755    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013775    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013821    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013861    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013889    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013917    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.013988    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014007    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014024    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014038    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014054    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014069    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014084    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014091    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014103    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014122    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrxk\" (UniqueName: \"kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014140    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014157    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014177    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014182    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-agent-certs\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014196    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014214    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014243    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198c39d2-beca-4447-abeb-3b57050cb3f6-metrics-tls\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014257    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgr7\" (UniqueName: \"kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014286    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014304    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.014303 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014348    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014450    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639d9b02-4e18-4090-905b-8ca6d4d8352a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014453    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014479    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014491    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-original-pull-secret\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014524    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014587    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014612    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-serving-certs-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014701    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014749    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014865    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014884    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-tls\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014895    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014929    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014955    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.014984    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015030    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015040    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015056    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015098    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015116    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015135    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015161    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015176    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015190    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015177    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1927717c-0969-4669-85cf-da2c7d741f42-metrics-certs\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015219    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015240    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8186db-5274-46ad-942c-6aca4b1d1686-iptables-alerter-script\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015265    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015291    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015292    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015335    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015363    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015370    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015378    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015385    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-textfile\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015386    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015398    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015443    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015479    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015498    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015515    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015530    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmvp\" (UniqueName: \"kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015548    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015634    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b4aab-bbce-4c31-8074-f79ff52f2cd1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015646    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015686    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015716    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015735    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015752    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015767    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-grpc-tls\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015791    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e919594-7e7d-413f-a997-80a2b9780006-etc-tuned\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015812    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015831    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015849    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015856    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxh5j\" (UniqueName: \"kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015873    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015888    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015907    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015960    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.015988    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016021    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016043    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016061    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016080    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016101    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016118    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016130    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016133    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016181    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016187    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77822f8f-dc1d-4774-99dd-673286558e56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016194    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016206    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016218    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7c0204-7117-4e6e-b910-953890e7d582-tmp-dir\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016231    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016238    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016257    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016279    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf645cc8-1325-4315-94b3-470599cf28e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016284    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016311    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016317    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8f3537e-25dc-4592-83c7-795b5f1d8af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016313    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016342    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016367    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016378    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016446    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016476    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2f325f0-14b6-4849-9db1-1def3092575f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016480    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc3eead-3ad0-46f2-b545-ec15921a2ab5-konnectivity-ca\") pod \"konnectivity-agent-g7bh6\" (UID: \"cdc3eead-3ad0-46f2-b545-ec15921a2ab5\") " pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016489    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016553    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016555    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016578    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-metrics-client-ca\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.016539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016589    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpp55\" (UniqueName: \"kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016649    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016696    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016792    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016844    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016867    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198c39d2-beca-4447-abeb-3b57050cb3f6-tmp-dir\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016874    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016898    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/751d219a-41af-4a6e-9eaf-25879c685574-serviceca\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016916    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2vx\" (UniqueName: \"kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.016999    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.017022    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.019302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.017066    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:57.050684 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.050646    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 00:29:57.050841 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.050704    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 31 00:29:57.050841 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.050738    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:29:57.050841 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.050738    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 31 00:29:57.051248 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.051234    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:29:57.054854 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.054833    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77822f8f-dc1d-4774-99dd-673286558e56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.054955 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.054863    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.054955 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.054891    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.055709 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.055690    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.055938 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.055917    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.057691 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.057673    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.067863 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.067843    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jxvr\" (UniqueName: \"kubernetes.io/projected/6e919594-7e7d-413f-a997-80a2b9780006-kube-api-access-4jxvr\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.067962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.067851    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxj7h\" (UniqueName: \"kubernetes.io/projected/7f8186db-5274-46ad-942c-6aca4b1d1686-kube-api-access-dxj7h\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.068225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.068207    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pq6m\" (UniqueName: \"kubernetes.io/projected/dafad05c-abe0-4a45-a8f4-b3ffb5aaf055-kube-api-access-5pq6m\") pod \"prometheus-operator-9cd89b74c-x6fw4\" (UID: \"dafad05c-abe0-4a45-a8f4-b3ffb5aaf055\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-x6fw4"
Oct 31 00:29:57.072994 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.072975    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw7g\" (UniqueName: \"kubernetes.io/projected/f8f3537e-25dc-4592-83c7-795b5f1d8af0-kube-api-access-ztw7g\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.073389 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.073363    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6kh\" (UniqueName: \"kubernetes.io/projected/8bcc5163-4382-4160-b05b-b6f745faafdb-kube-api-access-5v6kh\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.081993 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.081972    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58n4\" (UniqueName: \"kubernetes.io/projected/751d219a-41af-4a6e-9eaf-25879c685574-kube-api-access-x58n4\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.082100 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.082070    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdz8\" (UniqueName: \"kubernetes.io/projected/3a7c0204-7117-4e6e-b910-953890e7d582-kube-api-access-cwdz8\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.082215 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.082197    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg6t\" (UniqueName: \"kubernetes.io/projected/198c39d2-beca-4447-abeb-3b57050cb3f6-kube-api-access-hzg6t\") pod \"dns-default-hz4np\" (UID: \"198c39d2-beca-4447-abeb-3b57050cb3f6\") " pod="openshift-dns/dns-default-hz4np"
Oct 31 00:29:57.082280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.082260    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"prometheus-k8s-0\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.082313 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.082298    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"console-78b57f57c9-zpb6f\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") " pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:29:57.083965 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.083944    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"console-5696d45945-njv6j\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") " pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:29:57.084039 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.084015    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqcb\" (UniqueName: \"kubernetes.io/projected/72bc206e-b599-4c37-bb62-9c2d7047a85d-kube-api-access-8gqcb\") pod \"ingress-canary-mmb5b\" (UID: \"72bc206e-b599-4c37-bb62-9c2d7047a85d\") " pod="openshift-ingress-canary/ingress-canary-mmb5b"
Oct 31 00:29:57.084134 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.084115    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgdz\" (UniqueName: \"kubernetes.io/projected/1927717c-0969-4669-85cf-da2c7d741f42-kube-api-access-wfgdz\") pod \"network-metrics-daemon-xltzg\" (UID: \"1927717c-0969-4669-85cf-da2c7d741f42\") " pod="openshift-multus/network-metrics-daemon-xltzg"
Oct 31 00:29:57.085201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.085185    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgclh\" (UniqueName: \"kubernetes.io/projected/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kube-api-access-cgclh\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.087092 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.087071    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwjl\" (UniqueName: \"kubernetes.io/projected/5da59575-dc74-4cda-9e57-b9437c54dbd7-kube-api-access-clwjl\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.087241 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.087225    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q629\" (UniqueName: \"kubernetes.io/projected/611b4aab-bbce-4c31-8074-f79ff52f2cd1-kube-api-access-4q629\") pod \"kube-state-metrics-5dc8d7d89b-gpzd2\" (UID: \"611b4aab-bbce-4c31-8074-f79ff52f2cd1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-gpzd2"
Oct 31 00:29:57.090913 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.090898    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql9q\" (UniqueName: \"kubernetes.io/projected/639d9b02-4e18-4090-905b-8ca6d4d8352a-kube-api-access-dql9q\") pod \"metrics-server-767548898d-bt8ls\" (UID: \"639d9b02-4e18-4090-905b-8ca6d4d8352a\") " pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:29:57.108113 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.107752    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgr7\" (UniqueName: \"kubernetes.io/projected/cf645cc8-1325-4315-94b3-470599cf28e8-kube-api-access-6vgr7\") pod \"thanos-querier-554698664c-x6vzb\" (UID: \"cf645cc8-1325-4315-94b3-470599cf28e8\") " pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:29:57.108113 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.107825    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxh5j\" (UniqueName: \"kubernetes.io/projected/a2f325f0-14b6-4849-9db1-1def3092575f-kube-api-access-cxh5j\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.108113 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.108029    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"alertmanager-main-0\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:29:57.108314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.108125    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qv86\" (UniqueName: \"kubernetes.io/projected/a21b4377-105b-4b2f-a7a5-d93dc6f9be39-kube-api-access-7qv86\") pod \"network-check-target-lfth8\" (UID: \"a21b4377-105b-4b2f-a7a5-d93dc6f9be39\") " pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:29:57.108314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.108167    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrxk\" (UniqueName: \"kubernetes.io/projected/77822f8f-dc1d-4774-99dd-673286558e56-kube-api-access-kbrxk\") pod \"telemeter-client-566b5dddf-4lwr4\" (UID: \"77822f8f-dc1d-4774-99dd-673286558e56\") " pod="openshift-monitoring/telemeter-client-566b5dddf-4lwr4"
Oct 31 00:29:57.108314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.108181    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpp55\" (UniqueName: \"kubernetes.io/projected/8bff60fc-622d-4b2d-a935-537b4e9c3ae2-kube-api-access-mpp55\") pod \"openshift-state-metrics-7bd7489957-4czgl\" (UID: \"8bff60fc-622d-4b2d-a935-537b4e9c3ae2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-4czgl"
Oct 31 00:29:57.108314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.108290    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2vx\" (UniqueName: \"kubernetes.io/projected/fbff7817-a278-44aa-bb7d-5aacdbf7d4ac-kube-api-access-wp2vx\") pod \"monitoring-plugin-77f4f76594-w72zc\" (UID: \"fbff7817-a278-44aa-bb7d-5aacdbf7d4ac\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:29:57.113705 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.113687    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmvp\" (UniqueName: \"kubernetes.io/projected/03241bf1-5cee-42ff-90cf-d3ae59a39fae-kube-api-access-dmmvp\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117691 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117673    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117698    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.117768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117714    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.117768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117731    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.117768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117751    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117795    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117801    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117806    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117824    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117839    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-system-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117848    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117846    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-node-log\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117867    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117887    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117892    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3537e-25dc-4592-83c7-795b5f1d8af0-crio-socket\") pod \"insights-runtime-extractor-dggrt\" (UID: \"f8f3537e-25dc-4592-83c7-795b5f1d8af0\") " pod="openshift-insights/insights-runtime-extractor-dggrt"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117898    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117881    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117917    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-systemd-units\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117913    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-cnibin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117935    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117931    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.117967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117970    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-dbus\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.117976    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118011    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118020    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-systemd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118038    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118066    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-var-lib-kubelet\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118099    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118064    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-conf-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118104    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-sys\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118123    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118139    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118159    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118180    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-multus-certs\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118188    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-run-netns\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118216    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-etc-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118232    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118256    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118263    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118271    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118289    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118292    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-k8s-cni-cncf-io\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118312    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118337    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-var-lib-openvswitch\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118349    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118358    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-log-socket\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118378    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118394    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c7eb1ae-0643-472e-a33c-4c7c3b88a266-kubelet-config\") pod \"global-pull-secret-syncer-tpc6d\" (UID: \"8c7eb1ae-0643-472e-a33c-4c7c3b88a266\") " pod="kube-system/global-pull-secret-syncer-tpc6d"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118401    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118424    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118426    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-cni-dir\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118455    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-systemd\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118450    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118471    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-sys\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118490    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-hostroot\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118497    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118493    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118521    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-slash\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118538    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118562    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118587    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118592    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118631    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-run-ovn\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118642    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-multus\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118650    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118674    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118698    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118721    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.118689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118728    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-kubelet\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118732    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-bin\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118745    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-cnibin\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118743    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118763    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysconfig\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118774    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118781    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-cni-netd\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118792    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118819    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118827    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-cni-bin\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118832    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-multus-socket-dir-parent\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118846    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118875    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-run\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118876    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118909    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7c0204-7117-4e6e-b910-953890e7d582-hosts-file\") pod \"node-resolver-w9tkj\" (UID: \"3a7c0204-7117-4e6e-b910-953890e7d582\") " pod="openshift-dns/node-resolver-w9tkj"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118915    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118943    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-run-netns\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118943    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118968    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.118989    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119011    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119018    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-modprobe-d\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119034    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8186db-5274-46ad-942c-6aca4b1d1686-host-slash\") pod \"iptables-alerter-fwgw5\" (UID: \"7f8186db-5274-46ad-942c-6aca4b1d1686\") " pod="openshift-network-operator/iptables-alerter-fwgw5"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119038    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119032    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-sysctl-conf\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119061    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119066    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751d219a-41af-4a6e-9eaf-25879c685574-host\") pod \"node-ca-j4sq6\" (UID: \"751d219a-41af-4a6e-9eaf-25879c685574\") " pod="openshift-image-registry/node-ca-j4sq6"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119078    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119038    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119096    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119114    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03241bf1-5cee-42ff-90cf-d3ae59a39fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8ml2\" (UID: \"03241bf1-5cee-42ff-90cf-d3ae59a39fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119121    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119133    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-root\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119113    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2f325f0-14b6-4849-9db1-1def3092575f-system-cni-dir\") pod \"multus-additional-cni-plugins-2zp84\" (UID: \"a2f325f0-14b6-4849-9db1-1def3092575f\") " pod="openshift-multus/multus-additional-cni-plugins-2zp84"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119139    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-etc-kubernetes\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119146    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119152    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-host\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119170    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119187    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119203    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119220    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-etc-kubernetes\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119225    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119234    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bcc5163-4382-4160-b05b-b6f745faafdb-node-exporter-wtmp\") pod \"node-exporter-jwdtq\" (UID: \"8bcc5163-4382-4160-b05b-b6f745faafdb\") " pod="openshift-monitoring/node-exporter-jwdtq"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119252    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da59575-dc74-4cda-9e57-b9437c54dbd7-host-var-lib-kubelet\") pod \"multus-22sgf\" (UID: \"5da59575-dc74-4cda-9e57-b9437c54dbd7\") " pod="openshift-multus/multus-22sgf"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119258    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e-device-dir\") pod \"aws-ebs-csi-driver-node-hrrsm\" (UID: \"ed0e5c6c-6f68-4d3b-a07c-a7f5e6f9025e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrsm"
Oct 31 00:29:57.120486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.119295    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e919594-7e7d-413f-a997-80a2b9780006-lib-modules\") pod \"tuned-8nwg8\" (UID: \"6e919594-7e7d-413f-a997-80a2b9780006\") " pod="openshift-cluster-node-tuning-operator/tuned-8nwg8"
Oct 31 00:29:57.596105 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.596072    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:29:57.740698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:29:57.740664    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hz4np"
Oct 31 00:30:00.164216 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:00.164185    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-554698664c-x6vzb"
Oct 31 00:30:00.626330 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:00.626261    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:30:01.380274 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:01.380236    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:30:01.380681 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:01.380495    7559 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:30:03.865824 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:03.865743    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:30:04.056337 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:04.056301    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:30:05.240723 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:05.240699    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8ml2"
Oct 31 00:30:06.736092 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:06.736063    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-w72zc"
Oct 31 00:30:06.948752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:06.948724    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g7bh6"
Oct 31 00:30:07.233865 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:07.233829    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:30:16.583522 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:16.583485    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-767548898d-bt8ls"
Oct 31 00:30:18.079463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:18.079429    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:18.276856 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:18.276821    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:21.878761 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:21.878697    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-78b57f57c9-zpb6f" podUID="af81ff8e-3a14-417d-9bd9-705389fb906b" containerName="console" containerID="cri-o://66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c" gracePeriod=15
Oct 31 00:30:22.144130 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.144106    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:30:22.247665 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247630    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247665 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247671    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247694    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247723    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247762    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247784    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247855    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.247929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247889    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") pod \"af81ff8e-3a14-417d-9bd9-705389fb906b\" (UID: \"af81ff8e-3a14-417d-9bd9-705389fb906b\") "
Oct 31 00:30:22.248216 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.247985    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:22.248216 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248039    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:22.248311 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248230    7559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-service-ca\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.248311 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248250    7559 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af81ff8e-3a14-417d-9bd9-705389fb906b-tmp\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.248418 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248275    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:22.248418 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248377    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:22.248709 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.248432    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:22.250277 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.250255    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:22.250384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.250348    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:22.250423 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.250380    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb" pod "af81ff8e-3a14-417d-9bd9-705389fb906b" (UID: "af81ff8e-3a14-417d-9bd9-705389fb906b"). InnerVolumeSpecName "kube-api-access-rtdtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:22.348974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.348939    7559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-oauth-serving-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.348974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.348972    7559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-oauth-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.348974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.348981    7559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-trusted-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.349201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.348992    7559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af81ff8e-3a14-417d-9bd9-705389fb906b-console-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.349201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.349001    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtdtb\" (UniqueName: \"kubernetes.io/projected/af81ff8e-3a14-417d-9bd9-705389fb906b-kube-api-access-rtdtb\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.349201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.349011    7559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af81ff8e-3a14-417d-9bd9-705389fb906b-console-serving-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:22.958607 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.958570    7559 generic.go:356] "Generic (PLEG): container finished" podID="af81ff8e-3a14-417d-9bd9-705389fb906b" containerID="66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c" exitCode=0
Oct 31 00:30:22.958991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.958643    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b57f57c9-zpb6f"
Oct 31 00:30:22.958991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.958662    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b57f57c9-zpb6f" event={"ID":"af81ff8e-3a14-417d-9bd9-705389fb906b","Type":"ContainerDied","Data":"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"}
Oct 31 00:30:22.958991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.958718    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b57f57c9-zpb6f" event={"ID":"af81ff8e-3a14-417d-9bd9-705389fb906b","Type":"ContainerDied","Data":"baf6d1ffae4508b3fbbf86f29394506aa96318c79b2364418de4a95562670986"}
Oct 31 00:30:22.958991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.958748    7559 scope.go:122] "RemoveContainer" containerID="66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"
Oct 31 00:30:22.969710 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.969688    7559 scope.go:122] "RemoveContainer" containerID="66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"
Oct 31 00:30:22.970077 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:22.970033    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c\": container with ID starting with 66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c not found: ID does not exist" containerID="66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"
Oct 31 00:30:22.970178 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.970078    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c"} err="failed to get container status \"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c\": rpc error: code = NotFound desc = could not find container \"66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c\": container with ID starting with 66ded2a7014a17d2755a63d9484faf9579f75525151a6ddaea0ecb132f6a896c not found: ID does not exist"
Oct 31 00:30:22.970985 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:22.970663    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:23.117067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:23.117021    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:30:23.162057 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:23.162026    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:23.163461 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:23.163430    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78b57f57c9-zpb6f"]
Oct 31 00:30:23.361574 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:23.361489    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:23.778230 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:23.778195    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af81ff8e-3a14-417d-9bd9-705389fb906b" path="/var/lib/kubelet/pods/af81ff8e-3a14-417d-9bd9-705389fb906b/volumes"
Oct 31 00:30:24.059084 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:24.059008    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lfth8"
Oct 31 00:30:25.364410 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364379    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:30:25.364844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364710    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="alertmanager" containerID="cri-o://eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b" gracePeriod=120
Oct 31 00:30:25.364844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364769    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-metric" containerID="cri-o://da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496" gracePeriod=120
Oct 31 00:30:25.364844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364805    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy" containerID="cri-o://6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f" gracePeriod=120
Oct 31 00:30:25.365000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364862    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="config-reloader" containerID="cri-o://6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5" gracePeriod=120
Oct 31 00:30:25.365000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364778    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-web" containerID="cri-o://74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e" gracePeriod=120
Oct 31 00:30:25.365000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.364889    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="prom-label-proxy" containerID="cri-o://198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518" gracePeriod=120
Oct 31 00:30:25.634109 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.634086    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:30:25.779170 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779137    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779204    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779229    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779263    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779295    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779330    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779359    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779385    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779414    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779455    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779515    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779523    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:25.779560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779548    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.780195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779653    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") pod \"07275759-29b2-4d6d-8c25-9e80e907d310\" (UID: \"07275759-29b2-4d6d-8c25-9e80e907d310\") "
Oct 31 00:30:25.780195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.779685    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:25.780195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.780164    7559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-main-db\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.780195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.780187    7559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.780543 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.780516    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:25.783301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.783219    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.783428 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.783401    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:25.783589 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.783565    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.783752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.783730    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.783871 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.783850    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.785137 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.785091    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.785237 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.785172    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "kube-api-access-6px58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:25.785878 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.785855    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:25.787907 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.787886    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.795860 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.795839    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config" pod "07275759-29b2-4d6d-8c25-9e80e907d310" (UID: "07275759-29b2-4d6d-8c25-9e80e907d310"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881384    7559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881419    7559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-cluster-tls-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881438    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6px58\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-kube-api-access-6px58\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881449    7559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-web-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881460    7559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07275759-29b2-4d6d-8c25-9e80e907d310-metrics-client-ca\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881469    7559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-config-volume\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881478    7559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881486    7559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07275759-29b2-4d6d-8c25-9e80e907d310-tls-assets\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881494    7559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07275759-29b2-4d6d-8c25-9e80e907d310-config-out\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881503    7559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.881774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.881512    7559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07275759-29b2-4d6d-8c25-9e80e907d310-secret-alertmanager-main-tls\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974503    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518" exitCode=0
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974534    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496" exitCode=0
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974545    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f" exitCode=0
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974552    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e" exitCode=0
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974557    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5" exitCode=0
Oct 31 00:30:25.974537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974561    7559 generic.go:356] "Generic (PLEG): container finished" podID="07275759-29b2-4d6d-8c25-9e80e907d310" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b" exitCode=0
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974586    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974619    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974675    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974707    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974733    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974739    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974760    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974783    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"}
Oct 31 00:30:25.975005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.974806    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07275759-29b2-4d6d-8c25-9e80e907d310","Type":"ContainerDied","Data":"a759b72b86b329702159e876a638b5e7281bc7df9bd77cc85159af4db0a2d414"}
Oct 31 00:30:25.982785 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.982769    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:25.990298 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.990282    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:25.996976 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:25.996961    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.004486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.004472    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.011411 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.011393    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.018360 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.018337    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.028045 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.028019    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.028727 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.028695    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.028812 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.028736    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.028812 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.028762    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.029077 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.029053    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.029138 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029085    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.029138 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029101    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.029360 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.029342    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.029424 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029372    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.029424 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029392    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.029629 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.029613    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.029688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029636    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.029688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029655    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.029885 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.029863    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.029973 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029893    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.029973 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.029906    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.030147 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.030133    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.030200 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030150    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.030200 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030161    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.030387 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:26.030366    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.030431 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030393    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.030431 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030410    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.030664 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030645    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.030718 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030665    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.030896 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030881    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.030934 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.030897    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.031094 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031079    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.031146 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031095    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.031330 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031311    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.031396 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031330    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.031563 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031544    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.031638 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031564    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.031817 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031798    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.031893 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.031818    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.032063 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.032045    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.032063 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.032062    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.032368 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.032343    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.032433 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.032370    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.033034 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.033003    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.033034 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.033033    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.035733 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.035710    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.035733 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.035730    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.036216 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036198    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.036216 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036215    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.036470 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036453    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.036470 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036470    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.036737 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036717    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.036737 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036736    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.037005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.036981    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.037064 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037006    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.037263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037237    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.037315 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037263    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.037547 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037528    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.037614 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037548    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.037814 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037791    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.037814 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.037813    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.038028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038011    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.038074 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038029    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.038223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038208    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.038223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038223    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.038413 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038398    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.038454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038415    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.038654 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038636    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.038697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038656    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.038869 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038852    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.038908 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.038871    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.039096 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039082    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.039135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039097    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.039306 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039289    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.039347 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039308    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.039503 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039487    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.039539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039504    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.039725 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039711    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.039779 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039725    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.039917 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039900    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.039959 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.039918    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.040154 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040135    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.040227 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040156    7559 scope.go:122] "RemoveContainer" containerID="198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"
Oct 31 00:30:26.040465 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040445    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518"} err="failed to get container status \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": rpc error: code = NotFound desc = could not find container \"198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518\": container with ID starting with 198294b484264d9de1349236f492ab3cfafd72b1b7a62c69c6129e2d459f1518 not found: ID does not exist"
Oct 31 00:30:26.040465 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040465    7559 scope.go:122] "RemoveContainer" containerID="da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"
Oct 31 00:30:26.040783 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040765    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496"} err="failed to get container status \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": rpc error: code = NotFound desc = could not find container \"da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496\": container with ID starting with da5f51f2ccdea9020a65591621916bce07a188b35c824d2ea803299d97f81496 not found: ID does not exist"
Oct 31 00:30:26.040835 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.040784    7559 scope.go:122] "RemoveContainer" containerID="6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"
Oct 31 00:30:26.041062 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041042    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f"} err="failed to get container status \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": rpc error: code = NotFound desc = could not find container \"6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f\": container with ID starting with 6a6f4acccf1e7a243aa5b65ec557d87dfcd0870c65477264ac1b27dc3672983f not found: ID does not exist"
Oct 31 00:30:26.041140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041063    7559 scope.go:122] "RemoveContainer" containerID="74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"
Oct 31 00:30:26.041304 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041287    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e"} err="failed to get container status \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": rpc error: code = NotFound desc = could not find container \"74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e\": container with ID starting with 74148e9b9171b0e0d89b45f62a9ab818abb3515b73a7f32f2c0e1d78b9df285e not found: ID does not exist"
Oct 31 00:30:26.041349 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041305    7559 scope.go:122] "RemoveContainer" containerID="6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"
Oct 31 00:30:26.041501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041484    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5"} err="failed to get container status \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": rpc error: code = NotFound desc = could not find container \"6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5\": container with ID starting with 6d33f85ca5ca1f87ce4e16a72d0c50e2307b687a485b8ce30f9d481448eb8ee5 not found: ID does not exist"
Oct 31 00:30:26.041501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041501    7559 scope.go:122] "RemoveContainer" containerID="eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"
Oct 31 00:30:26.041730 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041711    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b"} err="failed to get container status \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": rpc error: code = NotFound desc = could not find container \"eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b\": container with ID starting with eef64d4c76f7ca1e13958ca37b8f30dd425ad0df5b9853732d1f58d3450a8c3b not found: ID does not exist"
Oct 31 00:30:26.041809 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041731    7559 scope.go:122] "RemoveContainer" containerID="62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"
Oct 31 00:30:26.041951 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.041933    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c"} err="failed to get container status \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": rpc error: code = NotFound desc = could not find container \"62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c\": container with ID starting with 62c4f601c3af734853da5b75e896989a961f1d14a62ff7688005a1e5a2bd4a9c not found: ID does not exist"
Oct 31 00:30:26.139326 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.139250    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:30:26.185456 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:26.185420    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:30:27.778010 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:27.777978    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" path="/var/lib/kubelet/pods/07275759-29b2-4d6d-8c25-9e80e907d310/volumes"
Oct 31 00:30:30.515939 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:30.515895    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:30.716376 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:30.716331    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:31.060803 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.060767    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:31.061127 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061093    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="prometheus" containerID="cri-o://744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4" gracePeriod=600
Oct 31 00:30:31.061404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061128    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy" containerID="cri-o://514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c" gracePeriod=600
Oct 31 00:30:31.061500 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061142    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0" gracePeriod=600
Oct 31 00:30:31.062379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061164    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-web" containerID="cri-o://4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17" gracePeriod=600
Oct 31 00:30:31.062379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061165    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="thanos-sidecar" containerID="cri-o://67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38" gracePeriod=600
Oct 31 00:30:31.062379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.061186    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="config-reloader" containerID="cri-o://87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489" gracePeriod=600
Oct 31 00:30:31.346903 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.346874    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:31.529713 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.529681    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.529744    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.529765    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.529941    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.529976    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530004    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530052    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530083    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530110    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.530148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530125    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530198    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530239    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530276    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530340    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530378    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530407    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.530655 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530442    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.531194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530508    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.531194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530833    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.531194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530886    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.531194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.530928    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") pod \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\" (UID: \"bae86b63-5c86-4f8b-92eb-b069c6412c5a\") "
Oct 31 00:30:31.531402 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.531234    7559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.532286 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.532217    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.533312 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.532769    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.533427 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.533398    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.534474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.533403    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.534474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.534428    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.534474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.533454    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.534474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.533842    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:31.534474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.534047    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.534908 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.534076    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.535144 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.535015    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:31.535144 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.535113    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:31.535270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.535135    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.535537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.535496    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.536336 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.536316    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "kube-api-access-6sp59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:31.536446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.536395    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:31.536822 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.536783    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.536915 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.536835    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.537397 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.537378    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.547249 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.547217    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config" pod "bae86b63-5c86-4f8b-92eb-b069c6412c5a" (UID: "bae86b63-5c86-4f8b-92eb-b069c6412c5a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632585    7559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-metrics-client-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632643    7559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632655    7559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config-out\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632664    7559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632674    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sp59\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-kube-api-access-6sp59\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632683    7559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-web-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632692    7559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.632697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632701    7559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632710    7559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632721    7559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-kube-rbac-proxy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632730    7559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bae86b63-5c86-4f8b-92eb-b069c6412c5a-tls-assets\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632738    7559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-metrics-client-ca\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632747    7559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632756    7559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-k8s-db\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632764    7559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae86b63-5c86-4f8b-92eb-b069c6412c5a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632774    7559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632783    7559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-grpc-tls\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632791    7559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:31.633050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:31.632800    7559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bae86b63-5c86-4f8b-92eb-b069c6412c5a-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:32.003407 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003367    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0" exitCode=0
Oct 31 00:30:32.003407 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003404    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c" exitCode=0
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003415    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17" exitCode=0
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003424    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38" exitCode=0
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003433    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489" exitCode=0
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003441    7559 generic.go:356] "Generic (PLEG): container finished" podID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4" exitCode=0
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003451    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003450    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"}
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003520    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"}
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003553    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"}
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003579    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"}
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003593    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003623    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"}
Oct 31 00:30:32.003644 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003649    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"}
Oct 31 00:30:32.004206 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.003673    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bae86b63-5c86-4f8b-92eb-b069c6412c5a","Type":"ContainerDied","Data":"9a65a9de3e08dccbdf8759ceab59ccf0b1105f61dcccc447cd41da63303135a0"}
Oct 31 00:30:32.013870 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.013837    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.023233 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.023211    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.030373 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.030353    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.037414 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.037392    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.044332 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.044311    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.051551 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.051533    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.058246 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.058227    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.058513 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.058492    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.058625 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.058521    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.058625 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.058540    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.058866 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.058847    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.058906 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.058872    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.058906 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.058888    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.059105 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.059090    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.059146 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059110    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.059146 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059123    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.059339 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.059322    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.059378 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059345    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.059378 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059358    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.059612 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.059583    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.059683 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059665    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.059725 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059686    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.059942 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.059924    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.059997 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059945    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.059997 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.059957    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.060210 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:32.060182    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.060248 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060214    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.060248 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060228    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.060466 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060447    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.060514 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060467    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.060696 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060673    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.060696 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060695    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.060890 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060874    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.060930 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.060890    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.061089 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061073    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.061131 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061090    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.061326 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061308    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.061365 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061327    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.061519 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061502    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.061559 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061519    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.061729 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061713    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.061772 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061729    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.061929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061913    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.061965 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.061928    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.062132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062117    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.062172 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062132    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.062342 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062323    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.062381 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062344    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.062574 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062550    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.062574 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062572    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.062803 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062787    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.062861 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062803    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.063010 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.062994    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.063010 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063008    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.063208 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063191    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.063253 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063208    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.063415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063397    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.063466 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063414    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.063671 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063655    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.063720 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063671    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.063889 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063874    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.063927 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.063888    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.064116 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064099    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.064159 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064116    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.064322 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064302    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.064322 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064322    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.064529 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064513    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.064575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064529    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.064744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064728    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.064744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064743    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.064944 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064926    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.064996 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.064944    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.065140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065124    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.065140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065138    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.065332 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065315    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.065384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065332    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.065538 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065520    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.065538 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065536    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.065750 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065732    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.065813 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065750    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.065947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065932    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.065947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.065946    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.066163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066146    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.066163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066162    7559 scope.go:122] "RemoveContainer" containerID="c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"
Oct 31 00:30:32.066386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066368    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0"} err="failed to get container status \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": rpc error: code = NotFound desc = could not find container \"c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0\": container with ID starting with c5a75b11e863c163eb2c25e58278e076e9468d1b44136a5e5daa6528b086f4a0 not found: ID does not exist"
Oct 31 00:30:32.066444 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066387    7559 scope.go:122] "RemoveContainer" containerID="514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"
Oct 31 00:30:32.066636 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066586    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c"} err="failed to get container status \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": rpc error: code = NotFound desc = could not find container \"514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c\": container with ID starting with 514d7acf6e962fd4f93c9684f1275ac7328fd54645ba8257247bb2ad30bb286c not found: ID does not exist"
Oct 31 00:30:32.066636 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066621    7559 scope.go:122] "RemoveContainer" containerID="4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"
Oct 31 00:30:32.066827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066809    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17"} err="failed to get container status \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": rpc error: code = NotFound desc = could not find container \"4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17\": container with ID starting with 4cce15b5f1f8ce3ee8b3ec69d7ef7b63bba8d151903aa94c81c282a13e69eb17 not found: ID does not exist"
Oct 31 00:30:32.066873 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.066827    7559 scope.go:122] "RemoveContainer" containerID="67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"
Oct 31 00:30:32.067024 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067008    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38"} err="failed to get container status \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": rpc error: code = NotFound desc = could not find container \"67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38\": container with ID starting with 67645a8980b65dec665228eebeebfd4675fc753f5f2bd7c0851f1927c44ecd38 not found: ID does not exist"
Oct 31 00:30:32.067065 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067025    7559 scope.go:122] "RemoveContainer" containerID="87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"
Oct 31 00:30:32.067212 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067197    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489"} err="failed to get container status \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": rpc error: code = NotFound desc = could not find container \"87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489\": container with ID starting with 87f4434f22da2ecadccec1b2f8d26536eeb1ef4b82371d9d556bb8e7cd451489 not found: ID does not exist"
Oct 31 00:30:32.067252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067212    7559 scope.go:122] "RemoveContainer" containerID="744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"
Oct 31 00:30:32.067460 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067441    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4"} err="failed to get container status \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": rpc error: code = NotFound desc = could not find container \"744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4\": container with ID starting with 744d5dd87e1ad132354131e17fe9e2cb3a9fa4dd896164ebbf9913f2f4fadcf4 not found: ID does not exist"
Oct 31 00:30:32.067509 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067473    7559 scope.go:122] "RemoveContainer" containerID="2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"
Oct 31 00:30:32.067706 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.067686    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881"} err="failed to get container status \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": rpc error: code = NotFound desc = could not find container \"2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881\": container with ID starting with 2dfb7553901e606643ba443adb4e54de2de16e62ca17a197b31515913a019881 not found: ID does not exist"
Oct 31 00:30:32.167532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.167499    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:32.213801 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.213758    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:32.214171 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214145    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:32.214694 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214672    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="init-config-reloader"
Oct 31 00:30:32.214694 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214693    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="init-config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214709    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="prom-label-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214717    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="prom-label-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214729    7559 cpu_manager.go:414] "containerMap: removing container" podUID="af81ff8e-3a14-417d-9bd9-705389fb906b" containerName="console"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214734    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af81ff8e-3a14-417d-9bd9-705389fb906b" containerName="console"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214743    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-thanos"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214749    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-thanos"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214769    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214776    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214788    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214794    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214801    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214806    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214812    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="prometheus"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214817    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="prometheus"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214825    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214829    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214834    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="init-config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214839    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="init-config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214850    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214857    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214864    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214870    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="config-reloader"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214880    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-metric"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214884    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-metric"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214893    7559 cpu_manager.go:414] "containerMap: removing container" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="thanos-sidecar"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214898    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="thanos-sidecar"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214905    7559 cpu_manager.go:414] "containerMap: removing container" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="alertmanager"
Oct 31 00:30:32.214919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214909    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="alertmanager"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214971    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214985    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="prometheus"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214993    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.214998    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="init-config-reloader"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215003    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215008    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="config-reloader"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215013    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-metric"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215018    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="thanos-sidecar"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215023    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="alertmanager"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215030    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="init-config-reloader"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215036    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="prom-label-proxy"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215041    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="af81ff8e-3a14-417d-9bd9-705389fb906b" containerName="console"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215046    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" containerName="kube-rbac-proxy-thanos"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215056    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="kube-rbac-proxy-web"
Oct 31 00:30:32.216036 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.215064    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="07275759-29b2-4d6d-8c25-9e80e907d310" containerName="config-reloader"
Oct 31 00:30:32.219145 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.219127    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.270357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270263    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:30:32.270357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270270    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:30:32.270357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270346    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:30:32.270790 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270691    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:30:32.270790 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270732    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:30:32.270790 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.270740    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:30:32.271086 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.271004    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:30:32.271086 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.271061    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:30:32.271183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.271089    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:30:32.317735 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317702    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317750    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317786    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-958gj\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317806    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fs297cs649aha\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317818    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317826    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:30:32.317936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.317785    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:30:32.336924 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.336889    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:32.337953 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.337923    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338095 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.337964    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338095 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.337989    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338243 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338092    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338243 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338216    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338348 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338257    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338348 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338281    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338348 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338330    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338493 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338350    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338554 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338479    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338554 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338546    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338763 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338578    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338763 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338710    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338763 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338740    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338763    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59qc\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-kube-api-access-g59qc\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338796    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338826    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.338867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338848    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.339015 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338868    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.339015 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.338899    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440174 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440142    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440174 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440177    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440199    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440221    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440240    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440255    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440281    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440324    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440351    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440371    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440400    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440420    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.440454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440444    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440462    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440489    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440530    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440552    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440575    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59qc\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-kube-api-access-g59qc\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440638    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440637    7559 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440674    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.440698    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441455 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.441097    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.441511 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.441483    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.443135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.442310    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.443135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.442865    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.443135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.442877    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.445189    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.445785    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.445809    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.445718    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.446263    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.446242    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.446460    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.446487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.446466    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.447190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.446470    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.447190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.447074    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.447314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.447261    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.448494 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.448216    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da9dbd75-bdb0-43ec-8f79-63b574105c0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.453352 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.453321    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da9dbd75-bdb0-43ec-8f79-63b574105c0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.502806 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.502779    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59qc\" (UniqueName: \"kubernetes.io/projected/da9dbd75-bdb0-43ec-8f79-63b574105c0e-kube-api-access-g59qc\") pod \"prometheus-k8s-0\" (UID: \"da9dbd75-bdb0-43ec-8f79-63b574105c0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.538700 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.538635    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:32.973671 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:32.973642    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:30:32.980971 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:30:32.980945    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9dbd75_bdb0_43ec_8f79_63b574105c0e.slice/crio-908476cef824dc2481fdfbcbcc2aee6ae3a5ac8d3d311a8cff4a853b30238dd3 WatchSource:0}: Error finding container 908476cef824dc2481fdfbcbcc2aee6ae3a5ac8d3d311a8cff4a853b30238dd3: Status 404 returned error can't find the container with id 908476cef824dc2481fdfbcbcc2aee6ae3a5ac8d3d311a8cff4a853b30238dd3
Oct 31 00:30:33.008122 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:33.008095    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"908476cef824dc2481fdfbcbcc2aee6ae3a5ac8d3d311a8cff4a853b30238dd3"}
Oct 31 00:30:33.724446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:33.724417    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:30:33.777820 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:33.777788    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bae86b63-5c86-4f8b-92eb-b069c6412c5a" path="/var/lib/kubelet/pods/bae86b63-5c86-4f8b-92eb-b069c6412c5a/volumes"
Oct 31 00:30:34.015021 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:34.014930    7559 generic.go:356] "Generic (PLEG): container finished" podID="da9dbd75-bdb0-43ec-8f79-63b574105c0e" containerID="20e039334dbe9e4369fc493e859c7fc9c99d2b834e15e4a1af00fe4fdd167beb" exitCode=0
Oct 31 00:30:34.015021 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:34.014978    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerDied","Data":"20e039334dbe9e4369fc493e859c7fc9c99d2b834e15e4a1af00fe4fdd167beb"}
Oct 31 00:30:35.022320 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022282    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"be53e01c4855883c44ed393c92f8f410a1b6dfb32d1217a241ecc646907f98d7"}
Oct 31 00:30:35.022844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022396    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"641ee5bb06afea8d1c554ae9530f81b74ea6ce61cb360bfde4ed29ffde9d99a9"}
Oct 31 00:30:35.022844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022449    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"2bbdc0e3feebab004059cdec801792ec1d74762cd7aa12a0cb3b9bdc22dcec3f"}
Oct 31 00:30:35.022844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022495    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"6154ccdef54518f2f42ee11e6ac1012590803ff7256e9b024ca1db5a46720148"}
Oct 31 00:30:35.022844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022536    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"ebf6c3d9416c40b75d41bb836b1e34b502687c723ca7616cea180ad38630df36"}
Oct 31 00:30:35.022844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.022574    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da9dbd75-bdb0-43ec-8f79-63b574105c0e","Type":"ContainerStarted","Data":"788cb1d25cbd530821cfa46d6f1484ba26444fda1b17d1bd3ea3177ce9f73d3e"}
Oct 31 00:30:35.151690 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:35.151627    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.135043938 podStartE2EDuration="3.151613635s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.569697ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:30:35.150837583 +0000 UTC m=+39.525732815" watchObservedRunningTime="2026-10-31 00:30:35.151613635 +0000 UTC m=+39.526508860"
Oct 31 00:30:37.235499 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:37.235457    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:30:37.539230 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:37.539145    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:30:38.831047 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:38.831003    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:42.130568 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:42.130533    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:42.325112 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:42.325078    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:30:58.744356 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:58.744297    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5696d45945-njv6j" podUID="71604ceb-556f-4409-bf6b-732a6e6196a0" containerName="console" containerID="cri-o://2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db" gracePeriod=15
Oct 31 00:30:59.014296 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.014273    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:30:59.061995 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.061969    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062025    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062057    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062078    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062115    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062354 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062155    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062354 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062185    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062354 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062215    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") pod \"71604ceb-556f-4409-bf6b-732a6e6196a0\" (UID: \"71604ceb-556f-4409-bf6b-732a6e6196a0\") "
Oct 31 00:30:59.062507 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062477    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:59.062555 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062520    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:59.062670 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062645    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:30:59.062799 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062774    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:59.062799 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.062787    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:59.064573 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.064546    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "kube-api-access-qm29s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:59.064573 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.064549    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:59.064760 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.064737    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config" pod "71604ceb-556f-4409-bf6b-732a6e6196a0" (UID: "71604ceb-556f-4409-bf6b-732a6e6196a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:30:59.117020 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.116957    7559 generic.go:356] "Generic (PLEG): container finished" podID="71604ceb-556f-4409-bf6b-732a6e6196a0" containerID="2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db" exitCode=0
Oct 31 00:30:59.117020 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.117006    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5696d45945-njv6j"
Oct 31 00:30:59.117174 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.117042    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5696d45945-njv6j" event={"ID":"71604ceb-556f-4409-bf6b-732a6e6196a0","Type":"ContainerDied","Data":"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"}
Oct 31 00:30:59.117174 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.117091    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5696d45945-njv6j" event={"ID":"71604ceb-556f-4409-bf6b-732a6e6196a0","Type":"ContainerDied","Data":"56d9a8c3b898c11ae71907370d003ac07b9f3cadd03b6012ce0fe7c57379848c"}
Oct 31 00:30:59.117174 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.117110    7559 scope.go:122] "RemoveContainer" containerID="2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"
Oct 31 00:30:59.125418 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.125402    7559 scope.go:122] "RemoveContainer" containerID="2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"
Oct 31 00:30:59.125713 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:30:59.125693    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db\": container with ID starting with 2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db not found: ID does not exist" containerID="2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"
Oct 31 00:30:59.125782 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.125721    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db"} err="failed to get container status \"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db\": rpc error: code = NotFound desc = could not find container \"2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db\": container with ID starting with 2cff50f9b76d78ac322978d24988f696d4c580fa4e7d1d550a3e103d3f12e8db not found: ID does not exist"
Oct 31 00:30:59.163693 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163670    7559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-service-ca\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163693 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163693    7559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-oauth-serving-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163705    7559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-console-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163714    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm29s\" (UniqueName: \"kubernetes.io/projected/71604ceb-556f-4409-bf6b-732a6e6196a0-kube-api-access-qm29s\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163724    7559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-oauth-config\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163733    7559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71604ceb-556f-4409-bf6b-732a6e6196a0-console-serving-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163741    7559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71604ceb-556f-4409-bf6b-732a6e6196a0-trusted-ca-bundle\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.163845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.163749    7559 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71604ceb-556f-4409-bf6b-732a6e6196a0-tmp\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:59.235653 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.235625    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:30:59.238662 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.238638    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5696d45945-njv6j"]
Oct 31 00:30:59.777846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:30:59.777811    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71604ceb-556f-4409-bf6b-732a6e6196a0" path="/var/lib/kubelet/pods/71604ceb-556f-4409-bf6b-732a6e6196a0/volumes"
Oct 31 00:31:03.963997 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:31:03.963954    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:31:03.980087 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:31:03.980062    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:31:04.152340 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:31:04.152312    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:31:07.234493 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:31:07.234443    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:31:37.234417 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:31:37.234335    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:31:39.184425 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:31:39.184386    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:31:39.429209 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:31:39.429173    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:32:07.234621 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:32:07.234565    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:32:20.891319 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:32:20.891273    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:32:36.479126 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:32:36.479094    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:32:36.716501 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:32:36.716435    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:32:37.233289 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:32:37.233257    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:32:39.529914 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:32:39.529881    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:05.250360 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:05.250272    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:05.513572 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:05.513490    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:07.234021 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:33:07.233990    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:33:10.766093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:10.766056    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:10.971587 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:10.971532    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:14.365306 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:14.365271    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:14.580463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:14.580430    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:15.550656 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:15.550617    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:16.990175 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:16.990086    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:17.210357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:17.210299    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:17.397906 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:17.397806    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:17.598288 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:17.598257    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:18.335818 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:18.335785    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:18.533610 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:18.533526    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:18.846704 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:18.846661    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:19.033494 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:19.033461    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:19.228054 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:19.228011    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:21.291522 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:21.291475    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:21.660502 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:21.660467    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:22.227086 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:22.227056    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:22.708106 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:22.708071    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:22.941815 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:22.941786    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:26.551425 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:26.551392    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:31.301202 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:31.301131    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:31.488952 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:31.488894    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:33:37.232727 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:33:37.232691    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:33:39.845713 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:33:39.845650    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:07.234044 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:34:07.234003    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:34:10.614650 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:10.614543    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:10.822352 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:10.822315    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:22.208312 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:22.208267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:22.462055 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:22.461967    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:25.695111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:25.695070    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:25.910769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:25.910732    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:29.641217 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:29.641182    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:29.930324 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:29.930292    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:30.188911 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.188836    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"]
Oct 31 00:34:30.189211 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.189190    7559 cpu_manager.go:414] "containerMap: removing container" podUID="71604ceb-556f-4409-bf6b-732a6e6196a0" containerName="console"
Oct 31 00:34:30.189361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.189226    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71604ceb-556f-4409-bf6b-732a6e6196a0" containerName="console"
Oct 31 00:34:30.189361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.189342    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="71604ceb-556f-4409-bf6b-732a6e6196a0" containerName="console"
Oct 31 00:34:30.191294 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.191275    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.280007 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.279977    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.280122 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.280032    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ln5c\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-kube-api-access-5ln5c\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.288296 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.288266    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ctdjs\""
Oct 31 00:34:30.288296 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.288273    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 00:34:30.288296 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.288295    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 00:34:30.288914 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.288898    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"]
Oct 31 00:34:30.380684 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.380657    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.380801 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.380742    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ln5c\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-kube-api-access-5ln5c\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.442777 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.442723    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.442920 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.442902    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ln5c\" (UniqueName: \"kubernetes.io/projected/6aff776b-d8df-4c93-9510-6a831d0c022c-kube-api-access-5ln5c\") pod \"cert-manager-webhook-5dbbbf75cc-jhfgp\" (UID: \"6aff776b-d8df-4c93-9510-6a831d0c022c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.510734 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.510708    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:30.522780 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.522759    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:30.744306 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.744221    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:30.888827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.888767    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"]
Oct 31 00:34:30.896313 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:34:30.896285    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aff776b_d8df_4c93_9510_6a831d0c022c.slice/crio-4de37a762915eeb9276b422c47f75854cdbc28ef36af11185936e3154830b943 WatchSource:0}: Error finding container 4de37a762915eeb9276b422c47f75854cdbc28ef36af11185936e3154830b943: Status 404 returned error can't find the container with id 4de37a762915eeb9276b422c47f75854cdbc28ef36af11185936e3154830b943
Oct 31 00:34:30.898253 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:30.898236    7559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:34:31.860493 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:31.860462    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp" event={"ID":"6aff776b-d8df-4c93-9510-6a831d0c022c","Type":"ContainerStarted","Data":"4de37a762915eeb9276b422c47f75854cdbc28ef36af11185936e3154830b943"}
Oct 31 00:34:32.005917 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:32.005886    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:32.479284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:32.479241    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:33.105481 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:33.105405    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:33.302253 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:33.302187    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:35.883995 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:35.883963    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp" event={"ID":"6aff776b-d8df-4c93-9510-6a831d0c022c","Type":"ContainerStarted","Data":"2513bcbf6fa5b025bbd65e4098ff9fb683cf12992c11d102b251a852125f8d8c"}
Oct 31 00:34:35.884396 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:35.884049    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:35.995316 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:35.995268    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp" podStartSLOduration=1.548388091 podStartE2EDuration="5.995250661s" totalImagesPullingTime="4.44686257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:35.994813626 +0000 UTC m=+280.369708860" watchObservedRunningTime="2026-10-31 00:34:35.995250661 +0000 UTC m=+280.370145883"
Oct 31 00:34:37.233025 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:34:37.232992    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:34:38.782628 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:38.782581    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:39.001339 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:39.001302    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:39.797875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:39.797849    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:40.172713 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:40.172677    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:40.433560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:40.433480    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:41.890621 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:41.890570    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jhfgp"
Oct 31 00:34:45.512313 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:45.512276    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:45.741199 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:45.741167    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:34:47.626560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.626526    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"]
Oct 31 00:34:47.632969 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.632950    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.729932 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.729902    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zj9bp\""
Oct 31 00:34:47.730055 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.729946    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:34:47.730162 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.730143    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 31 00:34:47.730621 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.730582    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"]
Oct 31 00:34:47.734483 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.734466    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ea78e8-b575-4764-afa9-b8b3cb389c03-tmp\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.734552 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.734537    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqg9\" (UniqueName: \"kubernetes.io/projected/b5ea78e8-b575-4764-afa9-b8b3cb389c03-kube-api-access-rqqg9\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.835607 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.835580    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqg9\" (UniqueName: \"kubernetes.io/projected/b5ea78e8-b575-4764-afa9-b8b3cb389c03-kube-api-access-rqqg9\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.835739 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.835645    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ea78e8-b575-4764-afa9-b8b3cb389c03-tmp\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.835947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.835933    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ea78e8-b575-4764-afa9-b8b3cb389c03-tmp\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.904504 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.904478    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqg9\" (UniqueName: \"kubernetes.io/projected/b5ea78e8-b575-4764-afa9-b8b3cb389c03-kube-api-access-rqqg9\") pod \"openshift-lws-operator-8465994787-rm9mf\" (UID: \"b5ea78e8-b575-4764-afa9-b8b3cb389c03\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:47.944726 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:47.944702    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"
Oct 31 00:34:48.329385 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:48.329300    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf"]
Oct 31 00:34:48.336897 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:34:48.336870    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5ea78e8_b575_4764_afa9_b8b3cb389c03.slice/crio-45a6618222bdf1b9820d2f463b774016ac35c0ab192f563864707e19c7a87cda WatchSource:0}: Error finding container 45a6618222bdf1b9820d2f463b774016ac35c0ab192f563864707e19c7a87cda: Status 404 returned error can't find the container with id 45a6618222bdf1b9820d2f463b774016ac35c0ab192f563864707e19c7a87cda
Oct 31 00:34:48.932176 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:48.932145    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf" event={"ID":"b5ea78e8-b575-4764-afa9-b8b3cb389c03","Type":"ContainerStarted","Data":"45a6618222bdf1b9820d2f463b774016ac35c0ab192f563864707e19c7a87cda"}
Oct 31 00:34:53.958184 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:53.958148    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf" event={"ID":"b5ea78e8-b575-4764-afa9-b8b3cb389c03","Type":"ContainerStarted","Data":"4afccc5c904b54d12adf785ef813e2bad89ce75ef59cb6634628cad6b75e52b8"}
Oct 31 00:34:54.078169 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:54.078106    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-8465994787-rm9mf" podStartSLOduration=1.84537556 podStartE2EDuration="7.078089603s" totalImagesPullingTime="5.232714043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:54.076106413 +0000 UTC m=+298.451001634" watchObservedRunningTime="2026-10-31 00:34:54.078089603 +0000 UTC m=+298.452984837"
Oct 31 00:34:57.835325 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:34:57.835280    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:03.084321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:03.084287    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:03.291213 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:03.291176    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:04.538665 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:04.538633    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:07.233173 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:35:07.233138    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:35:08.876087 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:08.876060    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:09.106585 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.106556    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:09.369388 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.369352    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"]
Oct 31 00:35:09.371929 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.371911    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.376733 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.376700    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:09.407043 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.407005    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-metrics-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.407043 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.407043    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-manager-config\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.407186 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.407160    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.407221 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.407188    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcml7\" (UniqueName: \"kubernetes.io/projected/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-kube-api-access-wcml7\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.468732 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.468704    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Oct 31 00:35:09.468869 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.468774    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Oct 31 00:35:09.469160 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.469137    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Oct 31 00:35:09.469273 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.469190    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7fllw\""
Oct 31 00:35:09.470131 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.470114    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"]
Oct 31 00:35:09.508567 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.508539    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.508698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.508570    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcml7\" (UniqueName: \"kubernetes.io/projected/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-kube-api-access-wcml7\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.508698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.508642    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-metrics-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.508698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.508671    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-manager-config\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.509361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.509339    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-manager-config\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.511110 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.511085    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-metrics-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.511198 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.511116    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-cert\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.569412 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.569390    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcml7\" (UniqueName: \"kubernetes.io/projected/f92c2e8d-401e-4ebe-9842-20b8f57ee8b2-kube-api-access-wcml7\") pod \"lws-controller-manager-c99f78588-t9bqq\" (UID: \"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2\") " pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:09.682457 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:09.682431    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:10.050726 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:10.050642    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"]
Oct 31 00:35:10.057407 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:35:10.057382    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92c2e8d_401e_4ebe_9842_20b8f57ee8b2.slice/crio-c0fdecd15851f3bc1ce54a464c82d6611e47cc3e0c75b3dbf0acc0855b6f93ee WatchSource:0}: Error finding container c0fdecd15851f3bc1ce54a464c82d6611e47cc3e0c75b3dbf0acc0855b6f93ee: Status 404 returned error can't find the container with id c0fdecd15851f3bc1ce54a464c82d6611e47cc3e0c75b3dbf0acc0855b6f93ee
Oct 31 00:35:11.021584 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:11.021550    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq" event={"ID":"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2","Type":"ContainerStarted","Data":"c0fdecd15851f3bc1ce54a464c82d6611e47cc3e0c75b3dbf0acc0855b6f93ee"}
Oct 31 00:35:12.940473 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:12.940441    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:13.184681 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:13.184644    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:14.033490 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:14.033456    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq" event={"ID":"f92c2e8d-401e-4ebe-9842-20b8f57ee8b2","Type":"ContainerStarted","Data":"f632085a7ed9f2de9be79f0fce117287aca1945cbcc46df71c84979f5ae5c5c7"}
Oct 31 00:35:14.033988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:14.033645    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:16.609393 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:16.609323    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:20.820004 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:20.819971    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:21.072150 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:21.072070    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:25.039481 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:25.039454    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq"
Oct 31 00:35:25.153167 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:25.153102    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c99f78588-t9bqq" podStartSLOduration=12.756461066 podStartE2EDuration="16.1530886s" totalImagesPullingTime="3.396627534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:35:14.150891146 +0000 UTC m=+318.525786370" watchObservedRunningTime="2026-10-31 00:35:25.1530886 +0000 UTC m=+329.527983820"
Oct 31 00:35:37.233818 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:35:37.233776    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:35:38.152878 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:38.152849    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:38.944909 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:38.944876    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:40.610134 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:40.610103    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:41.982110 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:41.982065    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:42.339536 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:42.339457    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:42.574614 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:42.574568    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:42.974150 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:42.974119    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:44.618675 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:44.618637    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:44.906913 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:44.906888    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:45.919137 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:45.919106    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"]
Oct 31 00:35:45.923339 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:45.923319    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:45.973700 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:45.973672    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"]
Oct 31 00:35:45.997583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:45.997555    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xn47\" (UniqueName: \"kubernetes.io/projected/8bd6518c-8473-4bc5-8bf5-13069ce2a458-kube-api-access-2xn47\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:45.997711 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:45.997688    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd6518c-8473-4bc5-8bf5-13069ce2a458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.019411 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.019372    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 00:35:46.019411 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.019390    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 00:35:46.019612 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.019483    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-72lxq\""
Oct 31 00:35:46.099055 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.099031    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd6518c-8473-4bc5-8bf5-13069ce2a458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.099191 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.099078    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xn47\" (UniqueName: \"kubernetes.io/projected/8bd6518c-8473-4bc5-8bf5-13069ce2a458-kube-api-access-2xn47\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.099423 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.099404    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd6518c-8473-4bc5-8bf5-13069ce2a458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.161507 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.161482    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xn47\" (UniqueName: \"kubernetes.io/projected/8bd6518c-8473-4bc5-8bf5-13069ce2a458-kube-api-access-2xn47\") pod \"kuadrant-operator-controller-manager-658c459c99-v5p56\" (UID: \"8bd6518c-8473-4bc5-8bf5-13069ce2a458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.236657 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.236568    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:46.354857 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.354823    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:46.662705 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:46.662674    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"]
Oct 31 00:35:46.671583 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:35:46.671558    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd6518c_8473_4bc5_8bf5_13069ce2a458.slice/crio-e8bf7618f53623bd934f2cd633dbe216eb79d8cefac4c40f28452a8b1a667a82 WatchSource:0}: Error finding container e8bf7618f53623bd934f2cd633dbe216eb79d8cefac4c40f28452a8b1a667a82: Status 404 returned error can't find the container with id e8bf7618f53623bd934f2cd633dbe216eb79d8cefac4c40f28452a8b1a667a82
Oct 31 00:35:47.150153 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:47.150061    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56" event={"ID":"8bd6518c-8473-4bc5-8bf5-13069ce2a458","Type":"ContainerStarted","Data":"e8bf7618f53623bd934f2cd633dbe216eb79d8cefac4c40f28452a8b1a667a82"}
Oct 31 00:35:47.447348 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:47.447312    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:48.625521 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:48.625470    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:50.060944 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:50.060910    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:52.158862 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:52.158823    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:52.501185 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:52.501113    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:52.971773 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:52.971739    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:56.189517 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:56.189482    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56" event={"ID":"8bd6518c-8473-4bc5-8bf5-13069ce2a458","Type":"ContainerStarted","Data":"5ec18b4b8217d15a104b6f67b0753cb5629c7fda0b1ae6696e10bd02523218b0"}
Oct 31 00:35:56.189917 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:56.189629    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:35:56.398483 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:56.398432    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56" podStartSLOduration=2.283750206 podStartE2EDuration="11.398419444s" totalImagesPullingTime="9.114669238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:35:56.352488377 +0000 UTC m=+360.727383598" watchObservedRunningTime="2026-10-31 00:35:56.398419444 +0000 UTC m=+360.773314667"
Oct 31 00:35:56.541508 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:56.541403    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:56.885591 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:56.885478    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:35:57.101853 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:35:57.101811    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:01.158183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:01.158143    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:01.461908 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:01.461796    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:02.429751 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:02.429675    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:03.624256 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:03.624174    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:04.044747 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:04.044700    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:06.085127 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:06.085083    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:06.281810 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:06.281781    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:07.195617 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:07.195564    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-v5p56"
Oct 31 00:36:07.234024 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:36:07.233990    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:36:10.799191 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:10.799155    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:11.013391 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:11.013352    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:16.211352 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:16.211309    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:16.415406 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:16.415371    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:16.638049 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:16.637961    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:16.836411 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:16.836383    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:17.106080 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:17.106019    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:17.335548 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:17.335517    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:23.056643 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:23.056592    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:23.254866 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:23.254834    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:25.524528 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:25.524498    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:25.720731 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:25.720701    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:37.233404 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:36:37.233361    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:36:40.861875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:40.861837    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:41.750386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:41.750351    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:42.075936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:42.075859    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:42.267731 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:42.267701    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:43.330050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.330013    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:43.332343 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.332329    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:43.357868 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.357844    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc44r\" (UniqueName: \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\") pod \"authorino-57f7f8659f-z6vc2\" (UID: \"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f\") " pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:43.383195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.383171    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9xw28\""
Oct 31 00:36:43.429387 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.429356    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:43.458707 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.458683    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc44r\" (UniqueName: \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\") pod \"authorino-57f7f8659f-z6vc2\" (UID: \"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f\") " pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:43.518440 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.518412    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc44r\" (UniqueName: \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\") pod \"authorino-57f7f8659f-z6vc2\" (UID: \"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f\") " pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:43.528451 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.528426    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:43.642877 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.642818    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:43.735408 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:43.735380    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:44.009950 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:44.009919    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:44.017960 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:36:44.017935    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dd0cb6c_6c8c_4e51_869c_8b0acb7a4c1f.slice/crio-dc852ad3d3ea00636f9a39877ff27ff75dcffe089d73e5d5eefff4dc64972523 WatchSource:0}: Error finding container dc852ad3d3ea00636f9a39877ff27ff75dcffe089d73e5d5eefff4dc64972523: Status 404 returned error can't find the container with id dc852ad3d3ea00636f9a39877ff27ff75dcffe089d73e5d5eefff4dc64972523
Oct 31 00:36:44.381102 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:44.381017    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" event={"ID":"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f","Type":"ContainerStarted","Data":"dc852ad3d3ea00636f9a39877ff27ff75dcffe089d73e5d5eefff4dc64972523"}
Oct 31 00:36:45.692978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.692946    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2jggx"]
Oct 31 00:36:45.696247 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.696230    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.746892 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.746870    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 00:36:45.773313 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.773283    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aba48895-ad53-41b5-bf42-c54e34e7e82f-config-file\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.773449 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.773316    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc9fw\" (UniqueName: \"kubernetes.io/projected/aba48895-ad53-41b5-bf42-c54e34e7e82f-kube-api-access-vc9fw\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.792964 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.792933    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2jggx"]
Oct 31 00:36:45.842173 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.842142    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5m87r\""
Oct 31 00:36:45.873910 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.873880    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aba48895-ad53-41b5-bf42-c54e34e7e82f-config-file\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.874062 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.873915    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc9fw\" (UniqueName: \"kubernetes.io/projected/aba48895-ad53-41b5-bf42-c54e34e7e82f-kube-api-access-vc9fw\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.874474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.874456    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aba48895-ad53-41b5-bf42-c54e34e7e82f-config-file\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.938190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.938163    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc9fw\" (UniqueName: \"kubernetes.io/projected/aba48895-ad53-41b5-bf42-c54e34e7e82f-kube-api-access-vc9fw\") pod \"limitador-limitador-7c9b87d574-2jggx\" (UID: \"aba48895-ad53-41b5-bf42-c54e34e7e82f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:45.979311 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:45.979247    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2jggx"]
Oct 31 00:36:46.008887 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:46.008862    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:46.380088 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:46.379997    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2jggx"]
Oct 31 00:36:46.388526 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:36:46.388498    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba48895_ad53_41b5_bf42_c54e34e7e82f.slice/crio-bddf5d4b0a302f420d8e4dd2955c8cc5b5fb6bb7883f4cb20d2736507c9490ef WatchSource:0}: Error finding container bddf5d4b0a302f420d8e4dd2955c8cc5b5fb6bb7883f4cb20d2736507c9490ef: Status 404 returned error can't find the container with id bddf5d4b0a302f420d8e4dd2955c8cc5b5fb6bb7883f4cb20d2736507c9490ef
Oct 31 00:36:47.395701 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:47.395664    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx" event={"ID":"aba48895-ad53-41b5-bf42-c54e34e7e82f","Type":"ContainerStarted","Data":"bddf5d4b0a302f420d8e4dd2955c8cc5b5fb6bb7883f4cb20d2736507c9490ef"}
Oct 31 00:36:49.295111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.295080    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:49.405314 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.405274    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" event={"ID":"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f","Type":"ContainerStarted","Data":"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"}
Oct 31 00:36:49.406858 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.406829    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx" event={"ID":"aba48895-ad53-41b5-bf42-c54e34e7e82f","Type":"ContainerStarted","Data":"509239c855c8a78311b36f29304b50c4eef75b69fbe9002119906e935f2effcd"}
Oct 31 00:36:49.406978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.406924    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:36:49.515577 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.515515    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" podStartSLOduration=2.166267644 podStartE2EDuration="6.515497615s" totalImagesPullingTime="4.349229971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:49.514483669 +0000 UTC m=+413.889378888" watchObservedRunningTime="2026-10-31 00:36:49.515497615 +0000 UTC m=+413.890392836"
Oct 31 00:36:49.627664 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:49.627542    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx" podStartSLOduration=2.424176562 podStartE2EDuration="4.627524559s" totalImagesPullingTime="2.203347997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:49.626751806 +0000 UTC m=+414.001647029" watchObservedRunningTime="2026-10-31 00:36:49.627524559 +0000 UTC m=+414.002419782"
Oct 31 00:36:50.410674 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:50.410637    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" podUID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" containerName="authorino" containerID="cri-o://869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d" gracePeriod=30
Oct 31 00:36:50.651530 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:50.651509    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:50.714102 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:50.714046    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\" (UniqueName: \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\") pod \"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f\" (UID: \"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f\") "
Oct 31 00:36:50.716133 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:50.716113    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r" pod "7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" (UID: "7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f"). InnerVolumeSpecName "kube-api-access-wc44r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:36:50.815506 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:50.815470    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc44r\" (UniqueName: \"kubernetes.io/projected/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f-kube-api-access-wc44r\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:36:51.415869 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.415837    7559 generic.go:356] "Generic (PLEG): container finished" podID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" containerID="869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d" exitCode=0
Oct 31 00:36:51.416270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.415881    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-z6vc2"
Oct 31 00:36:51.416270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.415918    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" event={"ID":"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f","Type":"ContainerDied","Data":"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"}
Oct 31 00:36:51.416270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.415960    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-z6vc2" event={"ID":"7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f","Type":"ContainerDied","Data":"dc852ad3d3ea00636f9a39877ff27ff75dcffe089d73e5d5eefff4dc64972523"}
Oct 31 00:36:51.416270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.415982    7559 scope.go:122] "RemoveContainer" containerID="869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"
Oct 31 00:36:51.423910 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.423894    7559 scope.go:122] "RemoveContainer" containerID="869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"
Oct 31 00:36:51.424203 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:36:51.424185    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d\": container with ID starting with 869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d not found: ID does not exist" containerID="869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"
Oct 31 00:36:51.424257 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.424211    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d"} err="failed to get container status \"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d\": rpc error: code = NotFound desc = could not find container \"869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d\": container with ID starting with 869138ebb730450d8ad3c51733e7b53411e908d3262c3e872a8ce5fbdf62171d not found: ID does not exist"
Oct 31 00:36:51.571395 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.571365    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:51.577747 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.577715    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-z6vc2"]
Oct 31 00:36:51.778988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:51.778915    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" path="/var/lib/kubelet/pods/7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f/volumes"
Oct 31 00:36:55.013974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:55.013944    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:36:56.348668 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:36:56.348634    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:00.411994 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:00.411960    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-2jggx"
Oct 31 00:37:07.233584 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:37:07.233547    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:37:08.760416 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:08.760381    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:08.957446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:08.957413    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:19.384046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:19.384008    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:19.651359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:19.651284    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:37.233236 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:37:37.233156    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:37:41.209759 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:41.209722    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:41.405585 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:41.405523    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:54.043254 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:54.043217    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:54.300862 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:54.300763    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:54.522571 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:54.522539    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:55.783441 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:55.783409    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:37:56.005335 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:37:56.005299    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:38:07.234380 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:38:07.234347    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:38:37.232788 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:38:37.232747    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:38:41.623556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:38:41.623519    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:38:49.461957 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:38:49.461923    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:07.233491 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:39:07.233454    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:39:15.125624 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:15.125567    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:15.343866 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:15.343827    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:25.889775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:25.889741    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:26.135744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:26.135711    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:26.377664 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:26.377628    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:26.572653 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:26.572576    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:31.407582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:31.407544    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:31.608266 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:31.608235    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:37.235289 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:39:37.235250    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:39:41.878685 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:41.878655    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:55.539914 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:55.539877    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:39:55.740188 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:39:55.740154    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:40:07.233004 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:40:07.232965    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:40:15.204385 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:40:15.204350    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:40:16.716556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:40:16.716519    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:40:37.233436 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:40:37.233353    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:40:42.272371 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:40:42.272336    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:40:42.536669 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:40:42.536567    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:00.456502 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:00.456462    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:07.233226 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:41:07.233195    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:41:08.884768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:08.884735    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:09.080053 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:09.080025    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:32.560105 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:32.560071    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:32.783610 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:32.783578    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:37.233682 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:41:37.233645    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:41:39.322492 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:39.322460    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:42.184761 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.184730    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:42.535120 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.535048    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:42.714474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.714448    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:41:42.714839 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.714825    7559 cpu_manager.go:414] "containerMap: removing container" podUID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" containerName="authorino"
Oct 31 00:41:42.714887 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.714842    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" containerName="authorino"
Oct 31 00:41:42.714926 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.714917    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="7dd0cb6c-6c8c-4e51-869c-8b0acb7a4c1f" containerName="authorino"
Oct 31 00:41:42.717798 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.717779    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.813280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.813201    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlrgh\" (UniqueName: \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.813280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.813236    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.814247 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.814225    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-epp-sa-dockercfg-np76l\""
Oct 31 00:41:42.814368 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.814259    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Oct 31 00:41:42.814434 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.814418    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"kube-root-ca.crt\""
Oct 31 00:41:42.814486 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.814452    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"openshift-service-ca.crt\""
Oct 31 00:41:42.814543 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.814489    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"default-dockercfg-7hq4t\""
Oct 31 00:41:42.815871 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.815852    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:41:42.872772 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.872748    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:42.914715 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.914692    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.914814 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.914782    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlrgh\" (UniqueName: \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.917104 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.917086    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:42.976041 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:42.976020    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlrgh\" (UniqueName: \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:43.030043 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:43.030019    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:43.397630 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:43.397539    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:41:43.405029 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:41:43.405001    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc769624_f9ad_40f4_b176_c607eafd7e86.slice/crio-1685a74cf0216575cb76c0b2ee3e662b225b18962c9a4ef10e158f1e28568347 WatchSource:0}: Error finding container 1685a74cf0216575cb76c0b2ee3e662b225b18962c9a4ef10e158f1e28568347: Status 404 returned error can't find the container with id 1685a74cf0216575cb76c0b2ee3e662b225b18962c9a4ef10e158f1e28568347
Oct 31 00:41:43.407000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:43.406981    7559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:41:43.595565 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:43.595533    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" event={"ID":"dc769624-f9ad-40f4-b176-c607eafd7e86","Type":"ContainerStarted","Data":"1685a74cf0216575cb76c0b2ee3e662b225b18962c9a4ef10e158f1e28568347"}
Oct 31 00:41:46.610862 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:46.610825    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" event={"ID":"dc769624-f9ad-40f4-b176-c607eafd7e86","Type":"ContainerStarted","Data":"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"}
Oct 31 00:41:46.611263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:46.610941    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:41:46.721783 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:46.721723    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podStartSLOduration=2.253340285 podStartE2EDuration="4.721704661s" totalImagesPullingTime="2.468364376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:46.721589756 +0000 UTC m=+711.096484988" watchObservedRunningTime="2026-10-31 00:41:46.721704661 +0000 UTC m=+711.096599885"
Oct 31 00:41:46.946544 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:46.946511    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:41:51.085186 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:41:51.085155    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:00.385591 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:00.385544    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:00.617019 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:00.616989    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:07.233591 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:42:07.233513    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:42:11.972056 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:11.972026    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:12.167762 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:12.167727    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:17.617853 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:17.617829    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:42:24.529572 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:24.529539    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:42:24.599392 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:24.599363    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:24.824844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:24.824774    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:27.617555 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:27.617516    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:42:37.233753 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:42:37.233718    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:42:37.617299 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:37.617221    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:42:39.549153 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:39.549093    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" containerID="cri-o://fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc" gracePeriod=45
Oct 31 00:42:42.939019 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:42.938983    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:42:47.617912 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:47.617868    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:42:47.618279 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:47.618025    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:42:57.617185 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:42:57.617148    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:43:07.233201 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:43:07.233166    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:43:07.617549 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:07.617477    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:43:09.782932 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.782909    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:43:09.796149 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.796126    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\" (UniqueName: \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\") pod \"dc769624-f9ad-40f4-b176-c607eafd7e86\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") "
Oct 31 00:43:09.796238 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.796157    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\") pod \"dc769624-f9ad-40f4-b176-c607eafd7e86\" (UID: \"dc769624-f9ad-40f4-b176-c607eafd7e86\") "
Oct 31 00:43:09.798321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.798290    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh" pod "dc769624-f9ad-40f4-b176-c607eafd7e86" (UID: "dc769624-f9ad-40f4-b176-c607eafd7e86"). InnerVolumeSpecName "kube-api-access-zlrgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:09.798553 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.798533    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs" pod "dc769624-f9ad-40f4-b176-c607eafd7e86" (UID: "dc769624-f9ad-40f4-b176-c607eafd7e86"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:43:09.897046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.896989    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlrgh\" (UniqueName: \"kubernetes.io/projected/dc769624-f9ad-40f4-b176-c607eafd7e86-kube-api-access-zlrgh\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:09.897046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.897015    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc769624-f9ad-40f4-b176-c607eafd7e86-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:09.950410 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.950382    7559 generic.go:356] "Generic (PLEG): container finished" podID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerID="fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc" exitCode=0
Oct 31 00:43:09.950513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.950427    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"
Oct 31 00:43:09.950513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.950455    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" event={"ID":"dc769624-f9ad-40f4-b176-c607eafd7e86","Type":"ContainerDied","Data":"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"}
Oct 31 00:43:09.950513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.950493    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6" event={"ID":"dc769624-f9ad-40f4-b176-c607eafd7e86","Type":"ContainerDied","Data":"1685a74cf0216575cb76c0b2ee3e662b225b18962c9a4ef10e158f1e28568347"}
Oct 31 00:43:09.950513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.950514    7559 scope.go:122] "RemoveContainer" containerID="fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"
Oct 31 00:43:09.959389 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.959373    7559 scope.go:122] "RemoveContainer" containerID="fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"
Oct 31 00:43:09.959643 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:43:09.959628    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc\": container with ID starting with fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc not found: ID does not exist" containerID="fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"
Oct 31 00:43:09.959697 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:09.959655    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc"} err="failed to get container status \"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc\": rpc error: code = NotFound desc = could not find container \"fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc\": container with ID starting with fb7356030b006879bdc2a1b6e2690250285366434313252157e476608d0aa9bc not found: ID does not exist"
Oct 31 00:43:10.106824 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:10.106799    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:43:10.113379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:10.113360    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859bjxsn6"]
Oct 31 00:43:11.778010 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:11.777981    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" path="/var/lib/kubelet/pods/dc769624-f9ad-40f4-b176-c607eafd7e86/volumes"
Oct 31 00:43:11.902808 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:11.902762    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:12.101652 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:12.101561    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:17.606229 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.606195    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:17.924567 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.924540    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:43:17.924867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.924855    7559 cpu_manager.go:414] "containerMap: removing container" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main"
Oct 31 00:43:17.924914 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.924869    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main"
Oct 31 00:43:17.924948 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.924917    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc769624-f9ad-40f4-b176-c607eafd7e86" containerName="main"
Oct 31 00:43:17.929150 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.929131    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:17.955406 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.955380    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:17.955510 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.955417    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9v5\" (UniqueName: \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:17.980010 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:17.979987    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"openshift-service-ca.crt\""
Oct 31 00:43:18.000547 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.000528    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"kube-root-ca.crt\""
Oct 31 00:43:18.025404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.025385    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-jgxph\""
Oct 31 00:43:18.025484 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.025386    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Oct 31 00:43:18.025484 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.025479    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"default-dockercfg-s9fdl\""
Oct 31 00:43:18.026933 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.026916    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:43:18.055769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.055746    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:18.055849 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.055775    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9v5\" (UniqueName: \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:18.058127 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.058111    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:18.075568 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.075548    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:18.115078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.115050    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9v5\" (UniqueName: \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:18.241042 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.240988    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:18.610919 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.610842    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:43:18.618180 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:43:18.618149    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4ad0a7_3d35_4fe5_b019_8e35a1fd622a.slice/crio-c5c758a6994e3023e1f61291314b51968c98e0104ebc861d9304388d20feaf3a WatchSource:0}: Error finding container c5c758a6994e3023e1f61291314b51968c98e0104ebc861d9304388d20feaf3a: Status 404 returned error can't find the container with id c5c758a6994e3023e1f61291314b51968c98e0104ebc861d9304388d20feaf3a
Oct 31 00:43:18.987489 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.987456    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" event={"ID":"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a","Type":"ContainerStarted","Data":"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"}
Oct 31 00:43:18.987661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.987503    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" event={"ID":"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a","Type":"ContainerStarted","Data":"c5c758a6994e3023e1f61291314b51968c98e0104ebc861d9304388d20feaf3a"}
Oct 31 00:43:18.987661 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:18.987592    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:19.100660 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:19.100582    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podStartSLOduration=2.100565602 podStartE2EDuration="2.100565602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:19.099850649 +0000 UTC m=+803.474745872" watchObservedRunningTime="2026-10-31 00:43:19.100565602 +0000 UTC m=+803.475460825"
Oct 31 00:43:19.735874 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:19.735839    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:26.157257 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:26.157210    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:26.365343 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:26.365316    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:28.296389 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:28.296358    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:37.234058 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:43:37.234020    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:43:43.210321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:43.210289    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:44.401949 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:44.401904    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:45.013752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:45.013716    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:45.262028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:45.261995    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:49.925301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:49.925267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:49.992961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:49.992933    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:43:56.460612 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:56.460558    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:58.800466 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:58.800432    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:43:58.857832 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:58.857787    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:59.163381 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:59.163345    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:43:59.993794 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:43:59.993763    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:44:02.140940 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.140900    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:44:02.145422 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.145402    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.195190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.195156    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 00:44:02.195190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.195183    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 00:44:02.195392 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.195175    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 00:44:02.241565 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.241522    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-q9j8d\""
Oct 31 00:44:02.268309 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.268263    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:44:02.301585 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301550    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.301585 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301585    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.301852 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301727    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.301852 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301812    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7fh2\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.301928 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301884    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.301928 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301921    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.302021 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.301937    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.302078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.302045    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.302129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.302080    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403374 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403287    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403374 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403329    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403374 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403364    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403431    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7fh2\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403460    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403494    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403514    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403545    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403930 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403756    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.403930 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403907    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.404035 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403974    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.404035 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.403994    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.404114 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.404040    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.404223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.404205    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.405974 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.405951    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.406384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.406365    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.463032 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.462986    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.463202 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.463147    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7fh2\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\") pod \"openshift-ai-inference-openshift-default-568c495856-zlffc\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:02.757765 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:02.757728    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:03.182072 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:03.182043    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:44:03.189354 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:44:03.189314    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b686f81_17e5_448c_88fe_ab774306fcff.slice/crio-d089c7b67f49c7c542a18f2393e394487f75ebddc577f153cfce3259296c4562 WatchSource:0}: Error finding container d089c7b67f49c7c542a18f2393e394487f75ebddc577f153cfce3259296c4562: Status 404 returned error can't find the container with id d089c7b67f49c7c542a18f2393e394487f75ebddc577f153cfce3259296c4562
Oct 31 00:44:04.167686 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:04.167641    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerStarted","Data":"d089c7b67f49c7c542a18f2393e394487f75ebddc577f153cfce3259296c4562"}
Oct 31 00:44:07.236443 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:44:07.236400    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:44:07.362193 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:07.362101    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:07.682968 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:07.682940    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:07.683046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:07.683031    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:07.683081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:07.683065    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:08.188237 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:08.188202    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerStarted","Data":"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"}
Oct 31 00:44:08.350848 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:08.350795    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podStartSLOduration=1.859865787 podStartE2EDuration="6.35077881s" totalImagesPullingTime="4.490913023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:08.349923638 +0000 UTC m=+852.724818858" watchObservedRunningTime="2026-10-31 00:44:08.35077881 +0000 UTC m=+852.725674031"
Oct 31 00:44:08.758401 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:08.758371    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:08.762786 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:08.762765    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:09.192777 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:09.192752    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:09.193833 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:09.193820    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:44:09.993615 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:09.993574    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:44:13.820134 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:13.820097    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" containerID="cri-o://7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319" gracePeriod=45
Oct 31 00:44:13.938936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:13.938909    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:17.273003 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.272968    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 00:44:17.278845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.278827    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323007 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.322981    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323154 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323030    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mp6\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323154 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323112    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323250 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323177    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323250 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323214    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323250 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323237    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323340    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323375    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.323479 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.323400    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.356638 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.356574    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 00:44:17.423901 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.423866    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424058 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.423928    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424058 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.423951    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424058 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.423978    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424058 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424032    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424089    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mp6\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424122    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424155    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424186    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424280 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424218    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424499 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424287    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424499 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424412    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424573 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424554    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.424936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.424918    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.426539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.426516    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.426854 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.426834    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.483708 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.483676    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.483956 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.483936    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mp6\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\") pod \"openshift-ai-inference-openshift-default-568c495856-q8ngg\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:17.592480 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:17.592411    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:18.015593 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.015555    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 00:44:18.022657 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:44:18.022627    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01ebc0c_ea87_4ffe_81a4_95f6a6d06245.slice/crio-f84aca7ab6f15c741de0722477dfd8b25034638cc137796cce79e893547565d6 WatchSource:0}: Error finding container f84aca7ab6f15c741de0722477dfd8b25034638cc137796cce79e893547565d6: Status 404 returned error can't find the container with id f84aca7ab6f15c741de0722477dfd8b25034638cc137796cce79e893547565d6
Oct 31 00:44:18.025355 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.025316    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:18.025439 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.025381    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:18.025439 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.025413    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:44:18.229727 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.229692    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerStarted","Data":"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"}
Oct 31 00:44:18.229878 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.229774    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerStarted","Data":"f84aca7ab6f15c741de0722477dfd8b25034638cc137796cce79e893547565d6"}
Oct 31 00:44:18.348055 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.347950    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podStartSLOduration=1.347933113 podStartE2EDuration="1.347933113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:18.347483646 +0000 UTC m=+862.722378869" watchObservedRunningTime="2026-10-31 00:44:18.347933113 +0000 UTC m=+862.722828336"
Oct 31 00:44:18.593421 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:18.593390    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:19.597912 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:19.597881    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:19.993621 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:19.993563    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:44:19.993775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:19.993673    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:44:20.237837 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:20.237810    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:20.238781 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:20.238763    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:44:29.993416 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:29.993381    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:44:37.233304 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:44:37.233262    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:44:39.993837 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:39.993803    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:44:43.541762 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:43.541729    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:44.064970 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.064946    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:44:44.145121 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.145042    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\") pod \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") "
Oct 31 00:44:44.145121 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.145097    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\" (UniqueName: \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\") pod \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\" (UID: \"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a\") "
Oct 31 00:44:44.147284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.147252    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5" pod "cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" (UID: "cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a"). InnerVolumeSpecName "kube-api-access-6s9v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:44:44.147284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.147269    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs" pod "cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" (UID: "cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:44:44.245856 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.245826    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:44.245856 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.245850    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s9v5\" (UniqueName: \"kubernetes.io/projected/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a-kube-api-access-6s9v5\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:44.335124 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.335093    7559 generic.go:356] "Generic (PLEG): container finished" podID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerID="7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319" exitCode=0
Oct 31 00:44:44.335252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.335137    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"
Oct 31 00:44:44.335252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.335145    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" event={"ID":"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a","Type":"ContainerDied","Data":"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"}
Oct 31 00:44:44.335252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.335209    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl" event={"ID":"cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a","Type":"ContainerDied","Data":"c5c758a6994e3023e1f61291314b51968c98e0104ebc861d9304388d20feaf3a"}
Oct 31 00:44:44.335252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.335231    7559 scope.go:122] "RemoveContainer" containerID="7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"
Oct 31 00:44:44.343845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.343827    7559 scope.go:122] "RemoveContainer" containerID="7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"
Oct 31 00:44:44.344107 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:44:44.344087    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319\": container with ID starting with 7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319 not found: ID does not exist" containerID="7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"
Oct 31 00:44:44.344204 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.344115    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319"} err="failed to get container status \"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319\": rpc error: code = NotFound desc = could not find container \"7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319\": container with ID starting with 7313d0f3dadfd14674d651da3009396df84667be1921c8930d4ba753158ab319 not found: ID does not exist"
Oct 31 00:44:44.491154 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.491122    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:44:44.497301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:44.497277    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schejdqfl"]
Oct 31 00:44:45.777856 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:45.777824    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" path="/var/lib/kubelet/pods/cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a/volumes"
Oct 31 00:44:45.881619 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:45.881572    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:46.077118 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:46.077044    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:52.592701 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:52.592667    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:55.117963 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.117934    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:55.455392 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.455351    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:44:55.455755 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.455732    7559 cpu_manager.go:414] "containerMap: removing container" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main"
Oct 31 00:44:55.455755 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.455756    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main"
Oct 31 00:44:55.455876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.455825    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf4ad0a7-3d35-4fe5-b019-8e35a1fd622a" containerName="main"
Oct 31 00:44:55.460288 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.460271    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.511355 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.511322    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Oct 31 00:44:55.511467 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.511361    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Oct 31 00:44:55.556961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.556938    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-86426\""
Oct 31 00:44:55.556961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.556951    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Oct 31 00:44:55.556961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.556953    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-kcf25\""
Oct 31 00:44:55.558050 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.558034    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:44:55.618605 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.618572    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:55.641209 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.641184    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.641297 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.641229    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9sn\" (UniqueName: \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.741672 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.741566    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9sn\" (UniqueName: \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.741836 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.741692    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.792195 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.792165    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Oct 31 00:44:55.805269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.805239    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:55.847985 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.847966    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Oct 31 00:44:55.898544 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.898521    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Oct 31 00:44:55.903375 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:55.903343    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9sn\" (UniqueName: \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:56.120768 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:56.120697    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-kcf25\""
Oct 31 00:44:56.171046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:56.171016    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-86426\""
Oct 31 00:44:56.173137 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:56.173120    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:56.546814 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:56.546786    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:44:56.553250 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:44:56.553217    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5eda4d1_5987_47e3_84f9_8af94959f8b5.slice/crio-80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b WatchSource:0}: Error finding container 80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b: Status 404 returned error can't find the container with id 80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b
Oct 31 00:44:57.390134 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:57.390097    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" event={"ID":"b5eda4d1-5987-47e3-84f9-8af94959f8b5","Type":"ContainerStarted","Data":"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"}
Oct 31 00:44:57.390538 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:57.390152    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" event={"ID":"b5eda4d1-5987-47e3-84f9-8af94959f8b5","Type":"ContainerStarted","Data":"80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b"}
Oct 31 00:44:57.390538 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:57.390193    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:44:59.263150 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:59.263111    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:44:59.465468 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:44:59.465436    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:06.279740 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:06.279708    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:45:06.280181 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:06.279760    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:45:06.619576 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:06.619494    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:07.233925 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:45:07.233890    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:45:07.435321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.435254    7559 generic.go:356] "Generic (PLEG): container finished" podID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerID="43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5" exitCode=0
Oct 31 00:45:07.435747 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.435321    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerDied","Data":"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"}
Oct 31 00:45:07.435813 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.435759    7559 scope.go:122] "RemoveContainer" containerID="43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"
Oct 31 00:45:07.436849 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.436820    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.436962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.436887    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.436962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.436916    7559 generic.go:356] "Generic (PLEG): container finished" podID="1b686f81-17e5-448c-88fe-ab774306fcff" containerID="9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6" exitCode=0
Oct 31 00:45:07.436962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.436926    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.437059 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.436961    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerDied","Data":"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"}
Oct 31 00:45:07.437274 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.437251    7559 scope.go:122] "RemoveContainer" containerID="9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"
Oct 31 00:45:07.438149 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.438125    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.438214 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.438183    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.438262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.438222    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:45:07.629884 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:07.629833    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podStartSLOduration=12.629820158 podStartE2EDuration="12.629820158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:57.5018354 +0000 UTC m=+901.876730623" watchObservedRunningTime="2026-10-31 00:45:07.629820158 +0000 UTC m=+912.004715376"
Oct 31 00:45:08.459745 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.459704    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerStarted","Data":"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"}
Oct 31 00:45:08.470990 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.470944    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerStarted","Data":"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"}
Oct 31 00:45:08.593032 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.592996    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:45:08.593295 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.593271    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Oct 31 00:45:08.593397 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.593327    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Oct 31 00:45:08.762681 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.760936    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:45:08.765515 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.765482    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zlffc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Oct 31 00:45:08.765789 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:08.765762    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Oct 31 00:45:09.193318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:09.193290    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:45:09.593402 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:09.593321    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Oct 31 00:45:09.593402 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:09.593380    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Oct 31 00:45:09.760624 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:09.760078    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zlffc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Oct 31 00:45:09.760624 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:09.760152    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Oct 31 00:45:10.593619 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:10.593558    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Oct 31 00:45:10.594103 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:10.593641    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Oct 31 00:45:10.763619 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:10.763102    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zlffc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Oct 31 00:45:10.763619 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:10.763175    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Oct 31 00:45:11.592928 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:11.592892    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Oct 31 00:45:11.593115 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:11.592944    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Oct 31 00:45:11.761623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:11.760965    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zlffc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Oct 31 00:45:11.761623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:11.761039    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Oct 31 00:45:12.592812 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:12.592776    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-q8ngg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Oct 31 00:45:12.592972 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:12.592827    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Oct 31 00:45:12.765627 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:12.761977    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zlffc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Oct 31 00:45:12.765627 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:12.762037    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Oct 31 00:45:13.596021 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:13.595993    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:45:13.596305 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:13.596285    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:45:13.597017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:13.596998    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 00:45:13.762159 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:13.762134    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:45:13.763096 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:13.763076    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:45:28.396683 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:28.396651    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:45:35.443406 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:35.443376    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:45:35.530467 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:35.530432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:35.768853 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:35.768776    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:37.233967 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:45:37.233935    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:45:38.396838 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:38.396807    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:45:41.754387 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:41.754355    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:41.958556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:41.958524    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:43.926806 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:43.926777    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:48.343533 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:48.343500    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:48.397384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:48.397345    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:45:48.537215 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:48.537188    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:48.925617 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:48.925572    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:49.419520 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:49.419490    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:50.462856 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:50.462822    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" containerID="cri-o://bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3" gracePeriod=45
Oct 31 00:45:57.301563 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:57.301525    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:45:58.396890 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:58.396856    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:45:58.397276 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:45:58.396963    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:46:07.233953 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:46:07.233912    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:46:08.396818 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:08.396776    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:46:18.397123 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:18.397081    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:46:20.588910 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:46:20.588879    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5eda4d1_5987_47e3_84f9_8af94959f8b5.slice/crio-80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b\": RecentStats: unable to find data in memory cache]"
Oct 31 00:46:20.707615 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.707582    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:46:20.788307 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.788249    7559 generic.go:356] "Generic (PLEG): container finished" podID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerID="bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3" exitCode=0
Oct 31 00:46:20.788307 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.788287    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"
Oct 31 00:46:20.788489 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.788316    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" event={"ID":"b5eda4d1-5987-47e3-84f9-8af94959f8b5","Type":"ContainerDied","Data":"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"}
Oct 31 00:46:20.788489 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.788350    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4" event={"ID":"b5eda4d1-5987-47e3-84f9-8af94959f8b5","Type":"ContainerDied","Data":"80ac93c014ffb71a629d1f76a3097a89a4ee880f7664733c2e7f8d4b33359a3b"}
Oct 31 00:46:20.788489 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.788371    7559 scope.go:122] "RemoveContainer" containerID="bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"
Oct 31 00:46:20.796545 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.796526    7559 scope.go:122] "RemoveContainer" containerID="bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"
Oct 31 00:46:20.796808 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:46:20.796787    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3\": container with ID starting with bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3 not found: ID does not exist" containerID="bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"
Oct 31 00:46:20.796909 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.796814    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3"} err="failed to get container status \"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3\": rpc error: code = NotFound desc = could not find container \"bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3\": container with ID starting with bdf117a7f2be4f6693d48da9e2b9af50fd040405c27870ae78d667cac768bdb3 not found: ID does not exist"
Oct 31 00:46:20.849967 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.849940    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\") pod \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") "
Oct 31 00:46:20.850085 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.850048    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\" (UniqueName: \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\") pod \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\" (UID: \"b5eda4d1-5987-47e3-84f9-8af94959f8b5\") "
Oct 31 00:46:20.852130 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.852096    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn" pod "b5eda4d1-5987-47e3-84f9-8af94959f8b5" (UID: "b5eda4d1-5987-47e3-84f9-8af94959f8b5"). InnerVolumeSpecName "kube-api-access-6b9sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:46:20.852220 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.852130    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs" pod "b5eda4d1-5987-47e3-84f9-8af94959f8b5" (UID: "b5eda4d1-5987-47e3-84f9-8af94959f8b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:46:20.951301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.951277    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9sn\" (UniqueName: \"kubernetes.io/projected/b5eda4d1-5987-47e3-84f9-8af94959f8b5-kube-api-access-6b9sn\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:46:20.951301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:20.951300    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5eda4d1-5987-47e3-84f9-8af94959f8b5-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:46:21.202725 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:21.202696    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:46:21.248853 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:21.248825    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bknmd4"]
Oct 31 00:46:21.778306 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:21.778276    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" path="/var/lib/kubelet/pods/b5eda4d1-5987-47e3-84f9-8af94959f8b5/volumes"
Oct 31 00:46:23.131773 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:23.131739    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:23.352169 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:23.352137    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:28.144787 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.144754    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:46:28.145138 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.145102    7559 cpu_manager.go:414] "containerMap: removing container" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main"
Oct 31 00:46:28.145138 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.145113    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main"
Oct 31 00:46:28.145218 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.145193    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5eda4d1-5987-47e3-84f9-8af94959f8b5" containerName="main"
Oct 31 00:46:28.148268 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.148249    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203447 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203417    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203610 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203462    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203690 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203625    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203715    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203834 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203788    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g8ll\" (UniqueName: \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.203834 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.203821    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.244798 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.244771    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"default-dockercfg-l6rcl\""
Oct 31 00:46:28.244926 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.244802    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Oct 31 00:46:28.244926 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.244809    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"openshift-service-ca.crt\""
Oct 31 00:46:28.244926 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.244849    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"kube-root-ca.crt\""
Oct 31 00:46:28.246130 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.246107    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:46:28.286208 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.286180    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:28.304688 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304670    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.304767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304696    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.304767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304720    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.304767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304743    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.304912 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304773    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g8ll\" (UniqueName: \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.304912 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.304880    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.305128 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.305112    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.305184 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.305170    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.305225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.305190    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.307064 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.307042    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.307252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.307238    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.365119 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.365089    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g8ll\" (UniqueName: \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\") pod \"scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.459335 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.459310    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:28.683568 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.683540    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:46:28.686425 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.686406    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.707841 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.707821    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwxf\" (UniqueName: \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.707947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.707929    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.737110 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.737061    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-svz8k\""
Oct 31 00:46:28.744155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.744132    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:46:28.808646 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.808615    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.808772 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.808673    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwxf\" (UniqueName: \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.811082 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.811056    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.842041 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.842002    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:28.860000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.859974    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:46:28.867776 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:46:28.867745    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3aff85_1dc0_4be0_80a5_bfa5249e876c.slice/crio-54dc48879a6f2fe6e8f347018221280d55045a21e3583fc2409050d133440f56 WatchSource:0}: Error finding container 54dc48879a6f2fe6e8f347018221280d55045a21e3583fc2409050d133440f56: Status 404 returned error can't find the container with id 54dc48879a6f2fe6e8f347018221280d55045a21e3583fc2409050d133440f56
Oct 31 00:46:28.869203 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.869184    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwxf\" (UniqueName: \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:28.998416 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:28.998350    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:29.365086 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.365019    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:46:29.372216 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:46:29.372192    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651836a5_9a32_4f96_9d00_a612cc5ccdb5.slice/crio-f3fd7ae8587ea2386bef3c0e1010e0bdbeed9bc8e71f70d8c82a961657abc99c WatchSource:0}: Error finding container f3fd7ae8587ea2386bef3c0e1010e0bdbeed9bc8e71f70d8c82a961657abc99c: Status 404 returned error can't find the container with id f3fd7ae8587ea2386bef3c0e1010e0bdbeed9bc8e71f70d8c82a961657abc99c
Oct 31 00:46:29.830194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.830148    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" event={"ID":"7d3aff85-1dc0-4be0-80a5-bfa5249e876c","Type":"ContainerStarted","Data":"54dc48879a6f2fe6e8f347018221280d55045a21e3583fc2409050d133440f56"}
Oct 31 00:46:29.832191 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.832155    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" event={"ID":"651836a5-9a32-4f96-9d00-a612cc5ccdb5","Type":"ContainerStarted","Data":"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"}
Oct 31 00:46:29.832325 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.832213    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" event={"ID":"651836a5-9a32-4f96-9d00-a612cc5ccdb5","Type":"ContainerStarted","Data":"f3fd7ae8587ea2386bef3c0e1010e0bdbeed9bc8e71f70d8c82a961657abc99c"}
Oct 31 00:46:29.832379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.832339    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:46:29.944530 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:29.944227    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podStartSLOduration=1.944210454 podStartE2EDuration="1.944210454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:29.943329651 +0000 UTC m=+994.318224897" watchObservedRunningTime="2026-10-31 00:46:29.944210454 +0000 UTC m=+994.319105676"
Oct 31 00:46:31.009569 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:31.009534    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:31.842589 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:31.842557    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" event={"ID":"7d3aff85-1dc0-4be0-80a5-bfa5249e876c","Type":"ContainerStarted","Data":"2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76"}
Oct 31 00:46:31.955893 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:31.955827    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" podStartSLOduration=1.486364765 podStartE2EDuration="3.955807813s" totalImagesPullingTime="2.469443048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:31.954240246 +0000 UTC m=+996.329135467" watchObservedRunningTime="2026-10-31 00:46:31.955807813 +0000 UTC m=+996.330703037"
Oct 31 00:46:32.460254 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:32.460221    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:33.625749 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:33.625709    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:37.233426 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:46:37.233393    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:46:37.613851 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:37.613777    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:37.800196 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:37.800150    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:38.460069 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:38.460023    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:38.472045 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:38.472014    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:38.887627 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:38.887539    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:46:44.213556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:44.213521    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:46:44.409734 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:46:44.409703    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:00.838273 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:00.838245    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:47:07.030082 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.030046    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:07.234091 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:47:07.234054    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:47:07.765777 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.765740    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:47:07.771628 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.771566    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:47:07.777113 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:47:07.777073    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76" cmd=["/bin/sleep","15"]
Oct 31 00:47:07.777293 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.777154    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 00:47:07.777293 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:47:07.777172    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main" containerID="cri-o://2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76"
Oct 31 00:47:07.777293 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.777215    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main" containerID="cri-o://2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76" gracePeriod=60
Oct 31 00:47:07.830767 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.830732    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:07.877310 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:07.877279    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Oct 31 00:47:08.013283 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.013252    7559 generic.go:356] "Generic (PLEG): container finished" podID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerID="2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76" exitCode=0
Oct 31 00:47:08.013469 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.013321    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" event={"ID":"7d3aff85-1dc0-4be0-80a5-bfa5249e876c","Type":"ContainerDied","Data":"2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76"}
Oct 31 00:47:08.033707 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.033637    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:08.123626 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.123589    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:47:08.234382 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234358    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234428    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\" (UniqueName: \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234453    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234491    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234715 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234530    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234715 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234556    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\") pod \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\" (UID: \"7d3aff85-1dc0-4be0-80a5-bfa5249e876c\") "
Oct 31 00:47:08.234934 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234909    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:47:08.235028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.234988    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:47:08.235126 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.235105    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:47:08.236625 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.236584    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:47:08.236739 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.236714    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "kube-api-access-4g8ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:47:08.237061 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.237037    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs" pod "7d3aff85-1dc0-4be0-80a5-bfa5249e876c" (UID: "7d3aff85-1dc0-4be0-80a5-bfa5249e876c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:47:08.335223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335150    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g8ll\" (UniqueName: \"kubernetes.io/projected/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-kube-api-access-4g8ll\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:08.335223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335199    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:08.335223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335214    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:08.335419 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335227    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:08.335419 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335239    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:08.335419 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:08.335250    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d3aff85-1dc0-4be0-80a5-bfa5249e876c-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:09.018562 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.018534    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"
Oct 31 00:47:09.018562 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.018557    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz" event={"ID":"7d3aff85-1dc0-4be0-80a5-bfa5249e876c","Type":"ContainerDied","Data":"54dc48879a6f2fe6e8f347018221280d55045a21e3583fc2409050d133440f56"}
Oct 31 00:47:09.018808 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.018634    7559 scope.go:122] "RemoveContainer" containerID="2c08a9d72fa871a28854e9060655d69e1718de4a49bb4ba77135734a1d733e76"
Oct 31 00:47:09.175149 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.175121    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:47:09.221056 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.221025    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-74cd6f7448-jgtfz"]
Oct 31 00:47:09.778028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:09.777998    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" path="/var/lib/kubelet/pods/7d3aff85-1dc0-4be0-80a5-bfa5249e876c/volumes"
Oct 31 00:47:10.838738 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:10.838704    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:47:20.457726 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:20.457693    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:20.651264 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:20.651234    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:20.838950 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:20.838879    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:47:22.791270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:22.791231    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main" containerID="cri-o://e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d" gracePeriod=45
Oct 31 00:47:30.837983 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:30.837940    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:47:30.838446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:30.838108    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:47:37.234026 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:47:37.233990    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:47:40.838809 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:40.838775    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:47:44.560872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:44.560837    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:49.329662 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.329639    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns_651836a5-9a32-4f96-9d00-a612cc5ccdb5/main/0.log"
Oct 31 00:47:49.332042 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.332027    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:47:49.468471 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.468448    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\" (UniqueName: \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\") pod \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") "
Oct 31 00:47:49.468617 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.468478    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\" (UniqueName: \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\") pod \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\" (UID: \"651836a5-9a32-4f96-9d00-a612cc5ccdb5\") "
Oct 31 00:47:49.470578 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.470546    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs" pod "651836a5-9a32-4f96-9d00-a612cc5ccdb5" (UID: "651836a5-9a32-4f96-9d00-a612cc5ccdb5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:47:49.470732 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.470611    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf" pod "651836a5-9a32-4f96-9d00-a612cc5ccdb5" (UID: "651836a5-9a32-4f96-9d00-a612cc5ccdb5"). InnerVolumeSpecName "kube-api-access-rtwxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:47:49.569904 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.569876    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtwxf\" (UniqueName: \"kubernetes.io/projected/651836a5-9a32-4f96-9d00-a612cc5ccdb5-kube-api-access-rtwxf\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:49.569904 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:49.569903    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/651836a5-9a32-4f96-9d00-a612cc5ccdb5-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:47:50.188239 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188212    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns_651836a5-9a32-4f96-9d00-a612cc5ccdb5/main/0.log"
Oct 31 00:47:50.188415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188255    7559 generic.go:356] "Generic (PLEG): container finished" podID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerID="e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d" exitCode=1
Oct 31 00:47:50.188415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188321    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"
Oct 31 00:47:50.188415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188344    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" event={"ID":"651836a5-9a32-4f96-9d00-a612cc5ccdb5","Type":"ContainerDied","Data":"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"}
Oct 31 00:47:50.188415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188404    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns" event={"ID":"651836a5-9a32-4f96-9d00-a612cc5ccdb5","Type":"ContainerDied","Data":"f3fd7ae8587ea2386bef3c0e1010e0bdbeed9bc8e71f70d8c82a961657abc99c"}
Oct 31 00:47:50.188577 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.188434    7559 scope.go:122] "RemoveContainer" containerID="e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"
Oct 31 00:47:50.196417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.196403    7559 scope.go:122] "RemoveContainer" containerID="e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"
Oct 31 00:47:50.196701 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:47:50.196683    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d\": container with ID starting with e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d not found: ID does not exist" containerID="e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"
Oct 31 00:47:50.196747 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.196715    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d"} err="failed to get container status \"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d\": rpc error: code = NotFound desc = could not find container \"e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d\": container with ID starting with e9636cbe6227ae3d84b23c56f9e25a87431fd75ba15de185daf0ebc993aed33d not found: ID does not exist"
Oct 31 00:47:50.345157 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.345137    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:47:50.391361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:50.391332    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6svpns"]
Oct 31 00:47:51.778027 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:51.777998    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" path="/var/lib/kubelet/pods/651836a5-9a32-4f96-9d00-a612cc5ccdb5/volumes"
Oct 31 00:47:52.468344 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:52.468317    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:52.660896 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:52.660847    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:55.650019 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:55.649950    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:47:55.899917 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:47:55.899876    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:02.586565 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:02.586533    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:04.965178 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:04.965084    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:05.269148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269067    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:48:05.269534 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269512    7559 cpu_manager.go:414] "containerMap: removing container" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main"
Oct 31 00:48:05.269654 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269536    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main"
Oct 31 00:48:05.269654 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269553    7559 cpu_manager.go:414] "containerMap: removing container" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main"
Oct 31 00:48:05.269654 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269562    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main"
Oct 31 00:48:05.269810 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269687    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="651836a5-9a32-4f96-9d00-a612cc5ccdb5" containerName="main"
Oct 31 00:48:05.269810 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.269701    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d3aff85-1dc0-4be0-80a5-bfa5249e876c" containerName="main"
Oct 31 00:48:05.274232 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.274211    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.344048 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.344025    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"kube-root-ca.crt\""
Oct 31 00:48:05.370500 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.370469    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"openshift-service-ca.crt\""
Oct 31 00:48:05.370651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.370498    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"scheduler-custom-template-test-epp-sa-dockercfg-w4fxh\""
Oct 31 00:48:05.370651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.370548    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"default-dockercfg-ptfl2\""
Oct 31 00:48:05.370651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.370629    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Oct 31 00:48:05.372156 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.372134    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:48:05.403898 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.403875    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rct26\" (UniqueName: \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.404012 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.403919    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.404081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.404020    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.404142 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.404127    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.416643 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.416619    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:05.504526 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504502    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.504643 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504554    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.504643 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504589    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rct26\" (UniqueName: \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.504721 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504651    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.504906 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504889    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.504975 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.504954    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.507078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.507061    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.565382 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.565322    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rct26\" (UniqueName: \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.585961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.585937    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:05.954861 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:05.954824    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:48:05.962083 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:48:05.962055    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f969809_ba07_45a8_93e0_bca4278e52f9.slice/crio-c1f1d234a1e43d05de080562f9670bc5cc5636305fff881fcc7000c73f99e8e0 WatchSource:0}: Error finding container c1f1d234a1e43d05de080562f9670bc5cc5636305fff881fcc7000c73f99e8e0: Status 404 returned error can't find the container with id c1f1d234a1e43d05de080562f9670bc5cc5636305fff881fcc7000c73f99e8e0
Oct 31 00:48:06.257532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:06.257447    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" event={"ID":"9f969809-ba07-45a8-93e0-bca4278e52f9","Type":"ContainerStarted","Data":"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"}
Oct 31 00:48:06.257532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:06.257497    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" event={"ID":"9f969809-ba07-45a8-93e0-bca4278e52f9","Type":"ContainerStarted","Data":"c1f1d234a1e43d05de080562f9670bc5cc5636305fff881fcc7000c73f99e8e0"}
Oct 31 00:48:06.257960 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:06.257577    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:06.371064 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:06.371013    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podStartSLOduration=1.3710002079999999 podStartE2EDuration="1.371000208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:48:06.369896018 +0000 UTC m=+1090.744791217" watchObservedRunningTime="2026-10-31 00:48:06.371000208 +0000 UTC m=+1090.745895429"
Oct 31 00:48:07.233471 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:48:07.233432    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:48:08.150028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:08.149994    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:08.354528 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:08.354493    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:09.733013 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:09.732978    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:09.930106 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:09.930041    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:14.068037 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:14.067989    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:15.470279 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:15.470243    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:19.125011 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.124965    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:48:19.128415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.128394    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.152869 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.152848    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.152962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.152883    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdwt\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.152962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.152907    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153058 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153038    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153093 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153076    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153104    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153158 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153150    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153168    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.153283 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.153264    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.232155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.232128    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:48:19.253991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.253969    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254006    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdwt\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254023    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254056    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254084    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254102    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254364 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254118    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254364 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254137    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254364 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254179    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254478    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254496    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254663 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254554    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.254663 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.254623    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.255227 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.255202    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.256991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.256967    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.257205 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.257186    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.313146 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.313121    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdwt\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.313229 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.313163    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-vr5gf\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.441283 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.441262    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:19.866105 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.866031    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:48:19.872767 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:48:19.872742    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda504fe6f_5ad4_4c08_9470_3b5a0486dce0.slice/crio-32544b0fd39b9b0303bd5206209b56ae429bc0617550fdfc937ec1cbe47fe5f2 WatchSource:0}: Error finding container 32544b0fd39b9b0303bd5206209b56ae429bc0617550fdfc937ec1cbe47fe5f2: Status 404 returned error can't find the container with id 32544b0fd39b9b0303bd5206209b56ae429bc0617550fdfc937ec1cbe47fe5f2
Oct 31 00:48:19.874716 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.874680    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:48:19.874809 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.874754    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:48:19.874809 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:19.874783    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 00:48:20.341623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.336944    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" event={"ID":"a504fe6f-5ad4-4c08-9470-3b5a0486dce0","Type":"ContainerStarted","Data":"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"}
Oct 31 00:48:20.341623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.337014    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" event={"ID":"a504fe6f-5ad4-4c08-9470-3b5a0486dce0","Type":"ContainerStarted","Data":"32544b0fd39b9b0303bd5206209b56ae429bc0617550fdfc937ec1cbe47fe5f2"}
Oct 31 00:48:20.445637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.445435    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:20.445637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.445577    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:20.445907 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.445649    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:20.550950 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:20.550701    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podStartSLOduration=1.550682239 podStartE2EDuration="1.550682239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:48:20.501540371 +0000 UTC m=+1104.876435592" watchObservedRunningTime="2026-10-31 00:48:20.550682239 +0000 UTC m=+1104.925577462"
Oct 31 00:48:21.448623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:21.445959    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:21.448623 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:21.446020    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:21.659068 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:21.659036    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:22.285845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:22.285814    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:22.442981 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:22.442943    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:22.443254 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:22.443226    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:22.494511 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:22.494479    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:22.702111 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:22.702083    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:23.446624 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:23.441882    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:23.446624 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:23.441954    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:24.435262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:24.435136    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:24.442317 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:24.441916    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:24.442317 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:24.441974    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:25.444980 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:25.444942    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 31 00:48:25.445539 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:25.445506    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 31 00:48:26.445681 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:26.445654    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:26.446056 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:26.445919    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:26.446507 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:26.446489    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:48:29.472392 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:29.472345    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:37.234194 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:48:37.234157    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:48:37.263145 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:37.263124    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:48:43.639187 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:43.639156    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:48:43.700275 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:43.700227    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:43.896348 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:43.896267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:44.895752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:44.895716    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:48:47.262936 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:47.262900    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:48:57.262560 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:57.262527    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:48:58.660405 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:48:58.660364    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" containerID="cri-o://c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686" gracePeriod=45
Oct 31 00:49:05.596846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:05.596813    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:05.831557 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:05.831524    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:07.233937 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:49:07.233895    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:49:07.262474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:07.262446    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:49:07.262640 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:07.262544    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:49:17.263056 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:17.263013    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:49:24.117658 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:24.117582    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:27.262873 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:27.262838    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:49:28.899085 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:28.899053    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:49:29.052357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052281    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\" (UniqueName: \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\") pod \"9f969809-ba07-45a8-93e0-bca4278e52f9\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") "
Oct 31 00:49:29.052357 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052349    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\") pod \"9f969809-ba07-45a8-93e0-bca4278e52f9\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") "
Oct 31 00:49:29.052582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052431    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\") pod \"9f969809-ba07-45a8-93e0-bca4278e52f9\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") "
Oct 31 00:49:29.052582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052497    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\") pod \"9f969809-ba07-45a8-93e0-bca4278e52f9\" (UID: \"9f969809-ba07-45a8-93e0-bca4278e52f9\") "
Oct 31 00:49:29.052752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052710    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache" pod "9f969809-ba07-45a8-93e0-bca4278e52f9" (UID: "9f969809-ba07-45a8-93e0-bca4278e52f9"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:29.052880 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.052778    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache" pod "9f969809-ba07-45a8-93e0-bca4278e52f9" (UID: "9f969809-ba07-45a8-93e0-bca4278e52f9"). InnerVolumeSpecName "cachi2-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:29.054703 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.054677    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26" pod "9f969809-ba07-45a8-93e0-bca4278e52f9" (UID: "9f969809-ba07-45a8-93e0-bca4278e52f9"). InnerVolumeSpecName "kube-api-access-rct26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:29.054703 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.054683    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs" pod "9f969809-ba07-45a8-93e0-bca4278e52f9" (UID: "9f969809-ba07-45a8-93e0-bca4278e52f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:29.153478 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.153456    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f969809-ba07-45a8-93e0-bca4278e52f9-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:29.153478 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.153478    7559 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-tokenizer-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:29.153651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.153488    7559 reconciler_common.go:299] "Volume detached for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f969809-ba07-45a8-93e0-bca4278e52f9-cachi2-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:29.153651 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.153497    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rct26\" (UniqueName: \"kubernetes.io/projected/9f969809-ba07-45a8-93e0-bca4278e52f9-kube-api-access-rct26\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:29.639238 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.639204    7559 generic.go:356] "Generic (PLEG): container finished" podID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerID="c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686" exitCode=0
Oct 31 00:49:29.639417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.639269    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"
Oct 31 00:49:29.639417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.639285    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" event={"ID":"9f969809-ba07-45a8-93e0-bca4278e52f9","Type":"ContainerDied","Data":"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"}
Oct 31 00:49:29.639417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.639362    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh" event={"ID":"9f969809-ba07-45a8-93e0-bca4278e52f9","Type":"ContainerDied","Data":"c1f1d234a1e43d05de080562f9670bc5cc5636305fff881fcc7000c73f99e8e0"}
Oct 31 00:49:29.639417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.639385    7559 scope.go:122] "RemoveContainer" containerID="c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"
Oct 31 00:49:29.648412 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.648397    7559 scope.go:122] "RemoveContainer" containerID="c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"
Oct 31 00:49:29.648675 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:49:29.648657    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686\": container with ID starting with c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686 not found: ID does not exist" containerID="c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"
Oct 31 00:49:29.648728 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.648683    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686"} err="failed to get container status \"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686\": rpc error: code = NotFound desc = could not find container \"c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686\": container with ID starting with c9ead4f02787987b1076139616d4e82d955d19fdf710e32ad95ce1f8dd997686 not found: ID does not exist"
Oct 31 00:49:29.796342 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.796319    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:49:29.842690 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:29.842668    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd5fqsjh"]
Oct 31 00:49:31.778070 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:31.778029    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" path="/var/lib/kubelet/pods/9f969809-ba07-45a8-93e0-bca4278e52f9/volumes"
Oct 31 00:49:31.860827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:31.860797    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:32.053559 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:32.053470    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:36.024645 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.024614    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:49:36.025023 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.024937    7559 cpu_manager.go:414] "containerMap: removing container" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main"
Oct 31 00:49:36.025023 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.024947    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main"
Oct 31 00:49:36.025023 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.025022    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f969809-ba07-45a8-93e0-bca4278e52f9" containerName="main"
Oct 31 00:49:36.029580 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.029555    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.085330 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.085298    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:49:36.107935 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.107903    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8r5v\" (UniqueName: \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.108081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.107952    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.108081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.108025    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.108081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.108043    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.108204 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.108098    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.108204 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.108195    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.125779 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.125750    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"default-dockercfg-xlmwv\""
Oct 31 00:49:36.125982 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.125958    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Oct 31 00:49:36.136016 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.135997    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"kube-root-ca.crt\""
Oct 31 00:49:36.136146 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.136130    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"openshift-service-ca.crt\""
Oct 31 00:49:36.177367 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.177344    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:36.208678 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208655    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8r5v\" (UniqueName: \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.208791 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208730    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.208857 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208809    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.208857 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208826    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.208857 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208844    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.208991 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.208884    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.209192 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.209168    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.209360 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.209205    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.209464 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.209284    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.211414 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.211391    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.211726 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.211706    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.267699 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.267670    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8r5v\" (UniqueName: \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.341706 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.341639    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:36.508845 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.508810    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:49:36.512270 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.512247    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.562909 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.562885    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-epp-sa-dockercfg-m9dw5\""
Oct 31 00:49:36.568695 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.568672    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:49:36.612899 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.612846    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.612899 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.612897    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76kl\" (UniqueName: \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.682381 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.682349    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:36.713692 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.713661    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.713798 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.713713    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n76kl\" (UniqueName: \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.716196 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.716179    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.738742 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.738712    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:49:36.745569 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:49:36.745542    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a7bc33_b507_4082_bc9d_ce2000c08bf2.slice/crio-9f5054566826ed0487536696f4ee45980beb267ba52c03a9b1358d01ec0254c5 WatchSource:0}: Error finding container 9f5054566826ed0487536696f4ee45980beb267ba52c03a9b1358d01ec0254c5: Status 404 returned error can't find the container with id 9f5054566826ed0487536696f4ee45980beb267ba52c03a9b1358d01ec0254c5
Oct 31 00:49:36.773611 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.773569    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76kl\" (UniqueName: \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:36.825110 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:36.825085    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:37.193135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.193109    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:49:37.200310 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:49:37.200282    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8513aaaf_7b81_479c_9bd3_01fd44b6ae4a.slice/crio-d2c2ee0a177b3fc9965253246646243f5bb0c6e077e20fde673946259b13e9b7 WatchSource:0}: Error finding container d2c2ee0a177b3fc9965253246646243f5bb0c6e077e20fde673946259b13e9b7: Status 404 returned error can't find the container with id d2c2ee0a177b3fc9965253246646243f5bb0c6e077e20fde673946259b13e9b7
Oct 31 00:49:37.235189 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:49:37.235093    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:49:37.674902 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.674859    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" event={"ID":"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a","Type":"ContainerStarted","Data":"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"}
Oct 31 00:49:37.675078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.674928    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" event={"ID":"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a","Type":"ContainerStarted","Data":"d2c2ee0a177b3fc9965253246646243f5bb0c6e077e20fde673946259b13e9b7"}
Oct 31 00:49:37.675078 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.674960    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:49:37.676406 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.676368    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" event={"ID":"34a7bc33-b507-4082-bc9d-ce2000c08bf2","Type":"ContainerStarted","Data":"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"}
Oct 31 00:49:37.676555 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.676421    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" event={"ID":"34a7bc33-b507-4082-bc9d-ce2000c08bf2","Type":"ContainerStarted","Data":"9f5054566826ed0487536696f4ee45980beb267ba52c03a9b1358d01ec0254c5"}
Oct 31 00:49:37.787580 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.787304    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podStartSLOduration=1.78728968 podStartE2EDuration="1.78728968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:49:37.786919075 +0000 UTC m=+1182.161814296" watchObservedRunningTime="2026-10-31 00:49:37.78728968 +0000 UTC m=+1182.162184903"
Oct 31 00:49:37.900920 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:37.900218    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" podStartSLOduration=2.900199994 podStartE2EDuration="2.900199994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:49:37.89883425 +0000 UTC m=+1182.273729471" watchObservedRunningTime="2026-10-31 00:49:37.900199994 +0000 UTC m=+1182.275095217"
Oct 31 00:49:38.342123 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:38.342094    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:39.152459 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:39.152429    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:45.223493 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:45.223462    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:45.423013 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:45.422984    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:45.676097 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:45.676063    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:46.183262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:46.183230    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:46.342753 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:46.342709    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:46.355038 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:46.355015    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:46.724189 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:46.724163    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:49:55.106005 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:55.105974    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:49:55.297583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:49:55.297551    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:02.066188 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:02.066153    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:03.853474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:03.853427    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:04.404781 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:04.404751    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:07.235250 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:50:07.235214    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:50:08.681487 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:08.681459    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:50:08.767281 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:08.767239    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:08.960587 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:08.960505    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:09.179452 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:09.179383    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:20.265129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.265096    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:50:20.266169 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.266145    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:50:20.276204 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:50:20.276168    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67" cmd=["/bin/sleep","15"]
Oct 31 00:50:20.276340 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.276221    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 00:50:20.276340 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:50:20.276234    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerName="main" containerID="cri-o://55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"
Oct 31 00:50:20.276340 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.276266    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerName="main" containerID="cri-o://55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67" gracePeriod=60
Oct 31 00:50:20.311714 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.311688    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:20.590384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.590316    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:20.617502 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.617480    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:50:20.709041 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709014    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709051    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709081    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709116    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\" (UniqueName: \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709162    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\" (UniqueName: \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709370 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709208    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\") pod \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\" (UID: \"34a7bc33-b507-4082-bc9d-ce2000c08bf2\") "
Oct 31 00:50:20.709370 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709276    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:20.709370 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709329    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:20.709532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709498    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:20.709593 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709556    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.709593 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.709574    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.711368 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.711346    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:20.711368 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.711351    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "kube-api-access-g8r5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:50:20.711490 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.711402    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs" pod "34a7bc33-b507-4082-bc9d-ce2000c08bf2" (UID: "34a7bc33-b507-4082-bc9d-ce2000c08bf2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:20.810344 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.810279    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.810344 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.810301    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34a7bc33-b507-4082-bc9d-ce2000c08bf2-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.810344 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.810315    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a7bc33-b507-4082-bc9d-ce2000c08bf2-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.810344 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.810326    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8r5v\" (UniqueName: \"kubernetes.io/projected/34a7bc33-b507-4082-bc9d-ce2000c08bf2-kube-api-access-g8r5v\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:20.875000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.874973    7559 generic.go:356] "Generic (PLEG): container finished" podID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerID="55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67" exitCode=0
Oct 31 00:50:20.875139 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.875006    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"
Oct 31 00:50:20.875139 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.875070    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" event={"ID":"34a7bc33-b507-4082-bc9d-ce2000c08bf2","Type":"ContainerDied","Data":"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"}
Oct 31 00:50:20.875139 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.875124    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992" event={"ID":"34a7bc33-b507-4082-bc9d-ce2000c08bf2","Type":"ContainerDied","Data":"9f5054566826ed0487536696f4ee45980beb267ba52c03a9b1358d01ec0254c5"}
Oct 31 00:50:20.875308 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.875156    7559 scope.go:122] "RemoveContainer" containerID="55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"
Oct 31 00:50:20.884398 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.884383    7559 scope.go:122] "RemoveContainer" containerID="55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"
Oct 31 00:50:20.884686 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:50:20.884659    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67\": container with ID starting with 55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67 not found: ID does not exist" containerID="55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"
Oct 31 00:50:20.884756 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:20.884686    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67"} err="failed to get container status \"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67\": rpc error: code = NotFound desc = could not find container \"55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67\": container with ID starting with 55cc481b4c0104b9c9d2f54735bb7c2ec1f0ac8ebab2ddc8f4ae57e77d809a67 not found: ID does not exist"
Oct 31 00:50:21.031485 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:21.031461    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:50:21.037429 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:21.037409    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-prefill-66d58bcdf9-2k992"]
Oct 31 00:50:21.778458 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:21.778427    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" path="/var/lib/kubelet/pods/34a7bc33-b507-4082-bc9d-ce2000c08bf2/volumes"
Oct 31 00:50:28.681824 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:28.681784    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:50:35.285227 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:35.285178    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main" containerID="cri-o://f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727" gracePeriod=45
Oct 31 00:50:37.233252 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:50:37.233218    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:50:38.681392 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:38.681351    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:50:45.628828 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:45.628783    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:46.802254 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:46.802221    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:47.012775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:47.012738    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:48.681762 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:48.681727    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:50:48.682156 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:48.681851    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:50:58.096299 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:58.096265    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:50:58.682183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:50:58.682146    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:51:05.535345 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.535315    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:51:05.604310 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.604259    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\" (UniqueName: \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\") pod \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") "
Oct 31 00:51:05.604310 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.604289    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\" (UniqueName: \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\") pod \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\" (UID: \"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a\") "
Oct 31 00:51:05.606332 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.606302    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs" pod "8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" (UID: "8513aaaf-7b81-479c-9bd3-01fd44b6ae4a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:05.606332 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.606326    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl" pod "8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" (UID: "8513aaaf-7b81-479c-9bd3-01fd44b6ae4a"). InnerVolumeSpecName "kube-api-access-n76kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:05.705385 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.705354    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:05.705385 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:05.705384    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n76kl\" (UniqueName: \"kubernetes.io/projected/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a-kube-api-access-n76kl\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:06.101206 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.101175    7559 generic.go:356] "Generic (PLEG): container finished" podID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerID="f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727" exitCode=0
Oct 31 00:51:06.101386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.101218    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"
Oct 31 00:51:06.101386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.101247    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" event={"ID":"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a","Type":"ContainerDied","Data":"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"}
Oct 31 00:51:06.101386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.101284    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l" event={"ID":"8513aaaf-7b81-479c-9bd3-01fd44b6ae4a","Type":"ContainerDied","Data":"d2c2ee0a177b3fc9965253246646243f5bb0c6e077e20fde673946259b13e9b7"}
Oct 31 00:51:06.101386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.101304    7559 scope.go:122] "RemoveContainer" containerID="f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"
Oct 31 00:51:06.109530 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.109496    7559 scope.go:122] "RemoveContainer" containerID="f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"
Oct 31 00:51:06.109842 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:51:06.109818    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727\": container with ID starting with f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727 not found: ID does not exist" containerID="f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"
Oct 31 00:51:06.109907 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.109851    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727"} err="failed to get container status \"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727\": rpc error: code = NotFound desc = could not find container \"f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727\": container with ID starting with f5a509cab3f09bd69966ac6fd37339ce3a6a282046989d6942b4cafb8f202727 not found: ID does not exist"
Oct 31 00:51:06.258179 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.258153    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:51:06.304657 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:06.304634    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69ngm6l"]
Oct 31 00:51:07.233587 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:51:07.233555    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:51:07.777946 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:07.777915    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" path="/var/lib/kubelet/pods/8513aaaf-7b81-479c-9bd3-01fd44b6ae4a/volumes"
Oct 31 00:51:11.370403 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:11.370365    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:11.629994 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:11.629923    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:18.531744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:18.531709    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:19.021089 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021057    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:51:19.021404 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021392    7559 cpu_manager.go:414] "containerMap: removing container" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main"
Oct 31 00:51:19.021453 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021405    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main"
Oct 31 00:51:19.021453 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021427    7559 cpu_manager.go:414] "containerMap: removing container" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerName="main"
Oct 31 00:51:19.021453 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021432    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerName="main"
Oct 31 00:51:19.021545 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021486    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="34a7bc33-b507-4082-bc9d-ce2000c08bf2" containerName="main"
Oct 31 00:51:19.021545 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.021496    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="8513aaaf-7b81-479c-9bd3-01fd44b6ae4a" containerName="main"
Oct 31 00:51:19.024517 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.024498    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.082470 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.082435    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:51:19.115656 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115628    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.115788 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115663    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5vwp\" (UniqueName: \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.115788 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115696    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.115862 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115804    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.115910 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115858    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.115962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.115948    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.121542 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.121521    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"default-dockercfg-grlwl\""
Oct 31 00:51:19.121720 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.121583    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Oct 31 00:51:19.123947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.123929    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"kube-root-ca.crt\""
Oct 31 00:51:19.124039 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.123958    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"openshift-service-ca.crt\""
Oct 31 00:51:19.187132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.187104    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:19.216379 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216355    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216485 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216394    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216585 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216573    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216675 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216621    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216766 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216740    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5vwp\" (UniqueName: \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216826 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216790    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216880 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216821    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216880 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216869    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.216989 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.216910    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.218876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.218858    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.218973 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.218854    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.276023 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.275955    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5vwp\" (UniqueName: \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.336924 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.336900    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:19.506321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.506287    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:51:19.509854 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.509838    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.560295 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.560232    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-epp-sa-dockercfg-2z9x2\""
Oct 31 00:51:19.566785 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.566760    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:51:19.620733 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.620707    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.620859 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.620764    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5r6q\" (UniqueName: \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.654034 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.653998    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:19.722305 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.722276    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.722509 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.722328    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5r6q\" (UniqueName: \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.724876 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.724851    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.781898 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.781872    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5r6q\" (UniqueName: \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedpwh97\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:19.785758 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.785737    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:51:19.793009 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:51:19.792989    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd8d9e5_aaa1_4501_ae1b_6f7d491511a7.slice/crio-c89ef1215aad32cbee49dd4b2b8714dde0da0d99dff10358dfb5132c115c071c WatchSource:0}: Error finding container c89ef1215aad32cbee49dd4b2b8714dde0da0d99dff10358dfb5132c115c071c: Status 404 returned error can't find the container with id c89ef1215aad32cbee49dd4b2b8714dde0da0d99dff10358dfb5132c115c071c
Oct 31 00:51:19.822079 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:19.822034    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:20.162668 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:20.162632    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" event={"ID":"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7","Type":"ContainerStarted","Data":"9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622"}
Oct 31 00:51:20.162849 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:20.162693    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" event={"ID":"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7","Type":"ContainerStarted","Data":"c89ef1215aad32cbee49dd4b2b8714dde0da0d99dff10358dfb5132c115c071c"}
Oct 31 00:51:20.191740 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:20.191715    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:51:20.198878 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:51:20.198857    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0305df90_228b_4c92_8199_0fb2b8ae0215.slice/crio-cba0f234fd8e4d5029cf8e07645c2d5542e435f7b1cb7a32fa83deda63f2f31e WatchSource:0}: Error finding container cba0f234fd8e4d5029cf8e07645c2d5542e435f7b1cb7a32fa83deda63f2f31e: Status 404 returned error can't find the container with id cba0f234fd8e4d5029cf8e07645c2d5542e435f7b1cb7a32fa83deda63f2f31e
Oct 31 00:51:20.274999 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:20.274957    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" podStartSLOduration=2.2749441040000002 podStartE2EDuration="2.274944104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:20.2747085 +0000 UTC m=+1284.649603722" watchObservedRunningTime="2026-10-31 00:51:20.274944104 +0000 UTC m=+1284.649839319"
Oct 31 00:51:20.337689 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:20.337663    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:21.168518 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:21.168478    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" event={"ID":"0305df90-228b-4c92-8199-0fb2b8ae0215","Type":"ContainerStarted","Data":"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"}
Oct 31 00:51:21.168920 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:21.168559    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" event={"ID":"0305df90-228b-4c92-8199-0fb2b8ae0215","Type":"ContainerStarted","Data":"cba0f234fd8e4d5029cf8e07645c2d5542e435f7b1cb7a32fa83deda63f2f31e"}
Oct 31 00:51:21.168920 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:21.168739    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:21.279969 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:21.279918    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podStartSLOduration=2.279902923 podStartE2EDuration="2.279902923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:21.279511636 +0000 UTC m=+1285.654406860" watchObservedRunningTime="2026-10-31 00:51:21.279902923 +0000 UTC m=+1285.654798143"
Oct 31 00:51:24.806908 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:24.806874    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:25.023769 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:25.023741    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:25.951894 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:25.951857    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:29.337305 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:29.337274    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:29.349363 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:29.349341    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:30.219223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:30.219197    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:51:36.276243 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:36.276208    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:36.469724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:36.469688    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:36.984546 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:36.984514    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:37.177140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:37.177103    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:37.236742 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:51:37.236705    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:51:41.079517 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:41.079485    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:43.684742 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:43.684711    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:45.477257 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:45.477220    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:45.901135 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:45.901058    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:47.631659 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:47.631620    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:47.828039 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:47.828005    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:48.216484 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:48.216454    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:48.404657 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:48.404591    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:50.976188 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:50.976149    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:51.165958 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:51.165926    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:51.424917 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:51.424887    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:51.685351 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:51.685245    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:51.939690 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:51.939617    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:52.175020 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:52.174993    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:51:52.666446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:52.666414    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:56.260387 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:56.260300    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:59.347800 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:59.347749    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:51:59.541374 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:51:59.541336    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:02.514962 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.514927    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:02.881350 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.881268    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:52:02.882132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.882108    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:52:02.891264 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:52:02.891225    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622" cmd=["/bin/sleep","15"]
Oct 31 00:52:02.891388 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.891281    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 00:52:02.891388 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:52:02.891294    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main" containerID="cri-o://9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622"
Oct 31 00:52:02.891388 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.891343    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main" containerID="cri-o://9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622" gracePeriod=60
Oct 31 00:52:02.905750 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:02.905728    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:03.094285 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.094254    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:03.209738 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.209691    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.38:8000/health\": dial tcp 10.133.0.38:8000: connect: connection refused"
Oct 31 00:52:03.361269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.361239    7559 generic.go:356] "Generic (PLEG): container finished" podID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerID="9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622" exitCode=0
Oct 31 00:52:03.361436 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.361311    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" event={"ID":"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7","Type":"ContainerDied","Data":"9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622"}
Oct 31 00:52:03.631143 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.631115    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:52:03.700910 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.700885    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\" (UniqueName: \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.700952    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.700984    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701046 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701012    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701124    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701163    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\") pod \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\" (UID: \"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7\") "
Oct 31 00:52:03.701326 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701248    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:03.701326 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701264    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:03.701441 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701399    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:03.701520 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701505    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:03.701570 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701523    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:03.701570 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.701533    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:03.703386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.703356    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:03.703512 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.703442    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:03.703570 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.703537    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp" pod "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" (UID: "dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7"). InnerVolumeSpecName "kube-api-access-r5vwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:03.802363 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.802337    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:03.802363 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.802362    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5vwp\" (UniqueName: \"kubernetes.io/projected/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-kube-api-access-r5vwp\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:03.802509 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:03.802373    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:04.368131 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.368096    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"
Oct 31 00:52:04.368327 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.368095    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8" event={"ID":"dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7","Type":"ContainerDied","Data":"c89ef1215aad32cbee49dd4b2b8714dde0da0d99dff10358dfb5132c115c071c"}
Oct 31 00:52:04.368327 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.368242    7559 scope.go:122] "RemoveContainer" containerID="9ef430569b6cd27e46eb19b2a66a8b7b763327938a17b530c188b39e45876622"
Oct 31 00:52:04.389574 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.389545    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:04.524284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.524259    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:52:04.570252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:04.570228    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-prefill-7776p7tj8"]
Oct 31 00:52:05.470901 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:05.470866    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:05.778359 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:05.778285    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" path="/var/lib/kubelet/pods/dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7/volumes"
Oct 31 00:52:05.956978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:05.956923    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:07.233301 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:52:07.233265    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:52:12.175887 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:12.175851    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:52:14.280645 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:14.280608    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:15.492805 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:15.492763    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:16.281308 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:16.281273    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:17.901881 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:17.901829    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main" containerID="cri-o://0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69" gracePeriod=45
Oct 31 00:52:20.903868 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:20.903823    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:22.175211 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:22.175166    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:52:26.440529 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:26.440479    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:26.991752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:26.991722    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:31.241143 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:31.241116    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:31.434342 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:31.434306    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:32.175893 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:32.175860    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:52:32.176081 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:32.175984    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:52:33.172509 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:33.172472    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:37.234303 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:52:37.234266    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:52:42.175017 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:42.174978    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:52:42.487891 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:42.487807    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:42.684992 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:42.684963    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:46.224367 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:46.224336    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:46.421129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:46.421068    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:48.149530 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.149508    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:52:48.269263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.269192    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\" (UniqueName: \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\") pod \"0305df90-228b-4c92-8199-0fb2b8ae0215\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") "
Oct 31 00:52:48.269263 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.269241    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\" (UniqueName: \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\") pod \"0305df90-228b-4c92-8199-0fb2b8ae0215\" (UID: \"0305df90-228b-4c92-8199-0fb2b8ae0215\") "
Oct 31 00:52:48.271491 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.271458    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q" pod "0305df90-228b-4c92-8199-0fb2b8ae0215" (UID: "0305df90-228b-4c92-8199-0fb2b8ae0215"). InnerVolumeSpecName "kube-api-access-p5r6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:48.271593 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.271513    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs" pod "0305df90-228b-4c92-8199-0fb2b8ae0215" (UID: "0305df90-228b-4c92-8199-0fb2b8ae0215"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:48.370584 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.370555    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5r6q\" (UniqueName: \"kubernetes.io/projected/0305df90-228b-4c92-8199-0fb2b8ae0215-kube-api-access-p5r6q\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:48.370584 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.370581    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0305df90-228b-4c92-8199-0fb2b8ae0215-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:48.555846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.555774    7559 generic.go:356] "Generic (PLEG): container finished" podID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerID="0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69" exitCode=0
Oct 31 00:52:48.555846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.555820    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"
Oct 31 00:52:48.555846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.555842    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" event={"ID":"0305df90-228b-4c92-8199-0fb2b8ae0215","Type":"ContainerDied","Data":"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"}
Oct 31 00:52:48.556033 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.555879    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97" event={"ID":"0305df90-228b-4c92-8199-0fb2b8ae0215","Type":"ContainerDied","Data":"cba0f234fd8e4d5029cf8e07645c2d5542e435f7b1cb7a32fa83deda63f2f31e"}
Oct 31 00:52:48.556033 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.555901    7559 scope.go:122] "RemoveContainer" containerID="0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"
Oct 31 00:52:48.564532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.564511    7559 scope.go:122] "RemoveContainer" containerID="0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"
Oct 31 00:52:48.564805 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:52:48.564789    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69\": container with ID starting with 0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69 not found: ID does not exist" containerID="0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"
Oct 31 00:52:48.564864 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.564813    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69"} err="failed to get container status \"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69\": rpc error: code = NotFound desc = could not find container \"0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69\": container with ID starting with 0b18d99323f139a9cc9290aa9b1f0887020a93dc949933db3ce734bb39b0ea69 not found: ID does not exist"
Oct 31 00:52:48.714961 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.713428    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:52:48.758744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:48.758683    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedpwh97"]
Oct 31 00:52:49.778153 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:49.778122    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" path="/var/lib/kubelet/pods/0305df90-228b-4c92-8199-0fb2b8ae0215/volumes"
Oct 31 00:52:53.159907 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:53.159874    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:53.360474 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:53.360432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:58.442640 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:58.442562    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:59.315532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315498    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:52:59.315844 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315831    7559 cpu_manager.go:414] "containerMap: removing container" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main"
Oct 31 00:52:59.315889 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315845    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main"
Oct 31 00:52:59.315889 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315861    7559 cpu_manager.go:414] "containerMap: removing container" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main"
Oct 31 00:52:59.315889 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315866    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main"
Oct 31 00:52:59.315979 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315935    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="0305df90-228b-4c92-8199-0fb2b8ae0215" containerName="main"
Oct 31 00:52:59.315979 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.315943    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="dfd8d9e5-aaa1-4501-ae1b-6f7d491511a7" containerName="main"
Oct 31 00:52:59.320290 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.320269    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.416537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.416503    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-epp-sa-dockercfg-hss4v\""
Oct 31 00:52:59.416537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.416500    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-kserve-self-signed-certs\""
Oct 31 00:52:59.416537 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.416528    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"kube-root-ca.crt\""
Oct 31 00:52:59.416808 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.416567    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"openshift-service-ca.crt\""
Oct 31 00:52:59.416808 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.416578    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"default-dockercfg-dw7n5\""
Oct 31 00:52:59.418208 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.418181    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:52:59.418628 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.418593    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:59.471676 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.471647    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rl6\" (UniqueName: \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.472000 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.471693    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.573152 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.573082    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97rl6\" (UniqueName: \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.573152 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.573126    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.575748 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.575721    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.612725 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.612674    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:52:59.632285 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.632258    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rl6\" (UniqueName: \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:52:59.635063 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:52:59.635046    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:53:00.005178 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.005142    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:53:00.013915 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:53:00.013883    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28870da8_678b_4c3f_af15_f99d10ecab18.slice/crio-af601ab3868227971f305bb258b43ff41f06c1a5d9b89aef5e25002ccf2ff069 WatchSource:0}: Error finding container af601ab3868227971f305bb258b43ff41f06c1a5d9b89aef5e25002ccf2ff069: Status 404 returned error can't find the container with id af601ab3868227971f305bb258b43ff41f06c1a5d9b89aef5e25002ccf2ff069
Oct 31 00:53:00.608872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.608836    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" event={"ID":"28870da8-678b-4c3f-af15-f99d10ecab18","Type":"ContainerStarted","Data":"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"}
Oct 31 00:53:00.609321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.608893    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" event={"ID":"28870da8-678b-4c3f-af15-f99d10ecab18","Type":"ContainerStarted","Data":"af601ab3868227971f305bb258b43ff41f06c1a5d9b89aef5e25002ccf2ff069"}
Oct 31 00:53:00.609321 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.608968    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:53:00.721505 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.721454    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podStartSLOduration=1.721439541 podStartE2EDuration="1.721439541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:53:00.720411876 +0000 UTC m=+1385.095307134" watchObservedRunningTime="2026-10-31 00:53:00.721439541 +0000 UTC m=+1385.096334762"
Oct 31 00:53:00.901939 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:00.901822    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:06.546410 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:06.546374    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:07.234165 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:53:07.234123    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:53:07.251577 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:07.251554    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:07.452148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:07.452119    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:31.614562 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:31.614533    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:53:37.234010 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:53:37.233962    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:53:43.262173 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:43.262135    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:53:44.804034 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:44.804001    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:44.997016 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:44.996985    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:46.561466 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:46.561432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:53:51.614391 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:51.614348    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:53:58.287223 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:53:58.287162    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main" containerID="cri-o://c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2" gracePeriod=45
Oct 31 00:54:01.614080 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:01.614045    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:54:07.233182 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:54:07.233100    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:54:11.614478 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:11.614438    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:54:11.614866 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:11.614561    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:54:21.614185 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:21.614143    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:54:28.539680 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.539656    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:54:28.589684 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.589622    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\" (UniqueName: \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\") pod \"28870da8-678b-4c3f-af15-f99d10ecab18\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") "
Oct 31 00:54:28.589796 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.589708    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\" (UniqueName: \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\") pod \"28870da8-678b-4c3f-af15-f99d10ecab18\" (UID: \"28870da8-678b-4c3f-af15-f99d10ecab18\") "
Oct 31 00:54:28.591927 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.591907    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6" pod "28870da8-678b-4c3f-af15-f99d10ecab18" (UID: "28870da8-678b-4c3f-af15-f99d10ecab18"). InnerVolumeSpecName "kube-api-access-97rl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:28.592008 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.591971    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs" pod "28870da8-678b-4c3f-af15-f99d10ecab18" (UID: "28870da8-678b-4c3f-af15-f99d10ecab18"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:28.690868 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.690843    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28870da8-678b-4c3f-af15-f99d10ecab18-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:28.690868 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.690865    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97rl6\" (UniqueName: \"kubernetes.io/projected/28870da8-678b-4c3f-af15-f99d10ecab18-kube-api-access-97rl6\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:28.985960 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.985923    7559 generic.go:356] "Generic (PLEG): container finished" podID="28870da8-678b-4c3f-af15-f99d10ecab18" containerID="c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2" exitCode=0
Oct 31 00:54:28.986132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.985972    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"
Oct 31 00:54:28.986132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.986009    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" event={"ID":"28870da8-678b-4c3f-af15-f99d10ecab18","Type":"ContainerDied","Data":"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"}
Oct 31 00:54:28.986132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.986063    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb" event={"ID":"28870da8-678b-4c3f-af15-f99d10ecab18","Type":"ContainerDied","Data":"af601ab3868227971f305bb258b43ff41f06c1a5d9b89aef5e25002ccf2ff069"}
Oct 31 00:54:28.986132 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.986084    7559 scope.go:122] "RemoveContainer" containerID="c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"
Oct 31 00:54:28.994713 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.994696    7559 scope.go:122] "RemoveContainer" containerID="c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"
Oct 31 00:54:28.994984 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:54:28.994969    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2\": container with ID starting with c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2 not found: ID does not exist" containerID="c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"
Oct 31 00:54:28.995035 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:28.994992    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2"} err="failed to get container status \"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2\": rpc error: code = NotFound desc = could not find container \"c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2\": container with ID starting with c5d5cc9c42c206057e496699edbca81896263483504bcdf433229e414db26fd2 not found: ID does not exist"
Oct 31 00:54:29.143458 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:29.143425    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:54:29.189796 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:29.189769    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-84d6588cvbvtb"]
Oct 31 00:54:29.777757 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:29.777726    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" path="/var/lib/kubelet/pods/28870da8-678b-4c3f-af15-f99d10ecab18/volumes"
Oct 31 00:54:30.056897 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:30.056813    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:30.256947 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:30.256902    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:33.674816 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:33.674772    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:33.873415 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:33.873360    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:35.862875 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:35.862847    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:36.066178 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:36.066141    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:36.320978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:36.320949    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:36.996779 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:36.996746    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:37.195938 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:37.195904    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:37.234026 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:54:37.233996    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:54:39.088900 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:39.088869    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:42.993571 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:42.993526    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:45.472706 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:45.472676    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:45.669449 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:45.669405    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:54:46.896432 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:54:46.896374    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:07.232999 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:07.232957    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:55:21.430446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:21.430414    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:21.644744 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:21.644712    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:24.586804 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:24.586767    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:24.802982 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:24.802953    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:28.712064 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:28.712023    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:29.237018 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:29.236979    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:32.426625 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:32.424393    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:37.234161 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:37.234124    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:55:37.519959 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:37.519858    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:55:37.520155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:37.520109    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy" containerID="cri-o://2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57" gracePeriod=30
Oct 31 00:55:37.566202 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:37.566170    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:55:37.566400 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:37.566359    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" containerID="cri-o://6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226" gracePeriod=30
Oct 31 00:55:37.571983 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:37.571940    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:39.418067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:39.418028    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:39.645279 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:39.645248    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:41.448678 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:41.448649    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-vr5gf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:55:41.449031 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:41.448702    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:55:42.604831 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:42.604804    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda504fe6f_5ad4_4c08_9470_3b5a0486dce0.slice/crio-conmon-6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 00:55:42.813926 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.813906    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:55:42.835498 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.835477    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:55:42.914953 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.914922    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915074 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.914962    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915074 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.914991    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915074 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915027    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915074 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915056    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915087    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915126    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915158    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915186    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915196    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915278 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915252    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915321    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915370    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915403    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915422    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915453    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915486    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915498    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915511    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915522    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.915575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915578    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\") pod \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\" (UID: \"a504fe6f-5ad4-4c08-9470-3b5a0486dce0\") "
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915652    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\") pod \"1b686f81-17e5-448c-88fe-ab774306fcff\" (UID: \"1b686f81-17e5-448c-88fe-ab774306fcff\") "
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915745    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915957    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.915984    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916005    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916019    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916032    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:42.916067 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916047    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:42.916460 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916219    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.916460 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916396    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.916460 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916411    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.916635 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.916537    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:42.918027 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.917991    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.918140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.918056    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "kube-api-access-xkdwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:42.918140 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.918080    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:55:42.918262 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.918174    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:42.918513 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.918493    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:42.918636 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.918511    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "kube-api-access-f7fh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:42.919106 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.919090    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo" pod "1b686f81-17e5-448c-88fe-ab774306fcff" (UID: "1b686f81-17e5-448c-88fe-ab774306fcff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:55:42.919168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:42.919144    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token" pod "a504fe6f-5ad4-4c08-9470-3b5a0486dce0" (UID: "a504fe6f-5ad4-4c08-9470-3b5a0486dce0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:43.017228 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017207    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017228 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017229    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017237    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017247    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkdwt\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-kube-api-access-xkdwt\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017258    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7fh2\" (UniqueName: \"kubernetes.io/projected/1b686f81-17e5-448c-88fe-ab774306fcff-kube-api-access-f7fh2\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017267    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017275    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017283    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b686f81-17e5-448c-88fe-ab774306fcff-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017294    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b686f81-17e5-448c-88fe-ab774306fcff-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017306    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b686f81-17e5-448c-88fe-ab774306fcff-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017316    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017324    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.017372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.017331    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a504fe6f-5ad4-4c08-9470-3b5a0486dce0-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:43.299677 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.299646    7559 generic.go:356] "Generic (PLEG): container finished" podID="1b686f81-17e5-448c-88fe-ab774306fcff" containerID="2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57" exitCode=0
Oct 31 00:55:43.299851 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.299708    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"
Oct 31 00:55:43.299851 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.299732    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerDied","Data":"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"}
Oct 31 00:55:43.299851 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.299790    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc" event={"ID":"1b686f81-17e5-448c-88fe-ab774306fcff","Type":"ContainerDied","Data":"d089c7b67f49c7c542a18f2393e394487f75ebddc577f153cfce3259296c4562"}
Oct 31 00:55:43.299851 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.299823    7559 scope.go:122] "RemoveContainer" containerID="2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"
Oct 31 00:55:43.301101 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.301084    7559 generic.go:356] "Generic (PLEG): container finished" podID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerID="6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226" exitCode=0
Oct 31 00:55:43.301197 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.301112    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" event={"ID":"a504fe6f-5ad4-4c08-9470-3b5a0486dce0","Type":"ContainerDied","Data":"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"}
Oct 31 00:55:43.301197 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.301147    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"
Oct 31 00:55:43.301197 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.301158    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf" event={"ID":"a504fe6f-5ad4-4c08-9470-3b5a0486dce0","Type":"ContainerDied","Data":"32544b0fd39b9b0303bd5206209b56ae429bc0617550fdfc937ec1cbe47fe5f2"}
Oct 31 00:55:43.309673 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.309654    7559 scope.go:122] "RemoveContainer" containerID="9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"
Oct 31 00:55:43.317003 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.316988    7559 scope.go:122] "RemoveContainer" containerID="2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"
Oct 31 00:55:43.317242 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:43.317225    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57\": container with ID starting with 2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57 not found: ID does not exist" containerID="2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"
Oct 31 00:55:43.317292 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.317253    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57"} err="failed to get container status \"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57\": rpc error: code = NotFound desc = could not find container \"2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57\": container with ID starting with 2460951946d3db339a16d897cc5e05114429ae38978902fe29573cd3f45e5f57 not found: ID does not exist"
Oct 31 00:55:43.317292 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.317268    7559 scope.go:122] "RemoveContainer" containerID="9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"
Oct 31 00:55:43.317505 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:43.317490    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6\": container with ID starting with 9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6 not found: ID does not exist" containerID="9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"
Oct 31 00:55:43.317546 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.317511    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6"} err="failed to get container status \"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6\": rpc error: code = NotFound desc = could not find container \"9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6\": container with ID starting with 9bb369188dc5c045c073e5bc2d176adeb39ab09e7a0e0ff9c405b4228935fbd6 not found: ID does not exist"
Oct 31 00:55:43.317546 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.317527    7559 scope.go:122] "RemoveContainer" containerID="6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"
Oct 31 00:55:43.324632 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.324590    7559 scope.go:122] "RemoveContainer" containerID="6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"
Oct 31 00:55:43.324868 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:55:43.324853    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226\": container with ID starting with 6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226 not found: ID does not exist" containerID="6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"
Oct 31 00:55:43.324930 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.324875    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226"} err="failed to get container status \"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226\": rpc error: code = NotFound desc = could not find container \"6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226\": container with ID starting with 6995c31f5ed1753f1e03cc00bebdb4ab0cb8072478077dba518191abb62da226 not found: ID does not exist"
Oct 31 00:55:43.459573 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.459546    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:55:43.472742 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.472722    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc"]
Oct 31 00:55:43.588986 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.588923    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:55:43.595946 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.595916    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf"]
Oct 31 00:55:43.777817 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.777788    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" path="/var/lib/kubelet/pods/1b686f81-17e5-448c-88fe-ab774306fcff/volumes"
Oct 31 00:55:43.778199 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:43.778186    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" path="/var/lib/kubelet/pods/a504fe6f-5ad4-4c08-9470-3b5a0486dce0/volumes"
Oct 31 00:55:47.313830 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:47.313797    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:55:47.508760 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:55:47.508713    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:07.234266 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:56:07.234231    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:56:08.686748 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:08.686716    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:08.913011 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:08.912958    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:15.846681 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:15.846640    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:16.945191 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:16.945158    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:17.662200 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662159    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:56:17.662516 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662503    7559 cpu_manager.go:414] "containerMap: removing container" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662516    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662535    7559 cpu_manager.go:414] "containerMap: removing container" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662540    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662553    7559 cpu_manager.go:414] "containerMap: removing container" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662558    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662567    7559 cpu_manager.go:414] "containerMap: removing container" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy"
Oct 31 00:56:17.662583 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662572    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy"
Oct 31 00:56:17.662881 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662643    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:56:17.662881 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662652    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="a504fe6f-5ad4-4c08-9470-3b5a0486dce0" containerName="istio-proxy"
Oct 31 00:56:17.662881 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.662662    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="28870da8-678b-4c3f-af15-f99d10ecab18" containerName="main"
Oct 31 00:56:17.665637 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.665592    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.687992 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.687963    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pckw\" (UniqueName: \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.688127 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.688073    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.697555 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.697531    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:17.761775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.761748    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-cdn7h\""
Oct 31 00:56:17.761775 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.761749    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-q4t4z\""
Oct 31 00:56:17.761988 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.761967    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\""
Oct 31 00:56:17.762048 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.761974    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\""
Oct 31 00:56:17.762048 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.761996    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\""
Oct 31 00:56:17.766878 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.766857    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:56:17.789454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.789428    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pckw\" (UniqueName: \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.789566 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.789513    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.792068 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.792049    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.864635 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.864589    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pckw\" (UniqueName: \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:17.895138 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.895108    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:17.977846 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:17.977788    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:18.355020 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:18.354946    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:56:18.362363 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:56:18.362339    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50475663_6c5f_4f5c_b405_595c5bca95f2.slice/crio-a8d49afbd8e80533658b908236e61c1f2b9361dd72bcf6ce12b08da0b9b8ec02 WatchSource:0}: Error finding container a8d49afbd8e80533658b908236e61c1f2b9361dd72bcf6ce12b08da0b9b8ec02: Status 404 returned error can't find the container with id a8d49afbd8e80533658b908236e61c1f2b9361dd72bcf6ce12b08da0b9b8ec02
Oct 31 00:56:18.447397 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:18.447363    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" event={"ID":"50475663-6c5f-4f5c-b405-595c5bca95f2","Type":"ContainerStarted","Data":"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"}
Oct 31 00:56:18.447551 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:18.447416    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" event={"ID":"50475663-6c5f-4f5c-b405-595c5bca95f2","Type":"ContainerStarted","Data":"a8d49afbd8e80533658b908236e61c1f2b9361dd72bcf6ce12b08da0b9b8ec02"}
Oct 31 00:56:18.447551 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:18.447452    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:18.561755 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:18.561672    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podStartSLOduration=1.561659852 podStartE2EDuration="1.561659852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:18.561339293 +0000 UTC m=+1582.936234512" watchObservedRunningTime="2026-10-31 00:56:18.561659852 +0000 UTC m=+1582.936555051"
Oct 31 00:56:23.027999 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:23.027964    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:23.222884 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:23.222852    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:26.997508 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:26.997474    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:27.220804 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:27.220776    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:37.234251 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:56:37.234216    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:56:46.430231 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:46.430200    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:47.596301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:47.596269    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:49.454732 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:49.454703    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:56:53.264166 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:53.264134    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:56:56.319155 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:56:56.319113    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:00.974217 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:00.974183    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:57:01.010369 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:01.010341    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:01.258749 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:01.258670    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:07.233888 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:57:07.233804    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:57:09.454894 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:09.454855    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:57:15.995199 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:15.995163    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main" containerID="cri-o://fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca" gracePeriod=45
Oct 31 00:57:19.455127 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:19.455092    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:57:26.884062 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:26.884027    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:27.078512 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:27.078482    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:29.454242 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:29.454205    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:57:29.454642 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:29.454327    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:57:37.234432 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:57:37.234394    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:57:39.454425 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:39.454393    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:57:46.239859 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.239836    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:57:46.293383 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.293325    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\" (UniqueName: \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\") pod \"50475663-6c5f-4f5c-b405-595c5bca95f2\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") "
Oct 31 00:57:46.293552 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.293392    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\" (UniqueName: \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\") pod \"50475663-6c5f-4f5c-b405-595c5bca95f2\" (UID: \"50475663-6c5f-4f5c-b405-595c5bca95f2\") "
Oct 31 00:57:46.295609 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.295569    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs" pod "50475663-6c5f-4f5c-b405-595c5bca95f2" (UID: "50475663-6c5f-4f5c-b405-595c5bca95f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:57:46.295700 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.295622    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw" pod "50475663-6c5f-4f5c-b405-595c5bca95f2" (UID: "50475663-6c5f-4f5c-b405-595c5bca95f2"). InnerVolumeSpecName "kube-api-access-4pckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:57:46.394884 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.394852    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pckw\" (UniqueName: \"kubernetes.io/projected/50475663-6c5f-4f5c-b405-595c5bca95f2-kube-api-access-4pckw\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:57:46.394884 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.394877    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50475663-6c5f-4f5c-b405-595c5bca95f2-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:57:46.808971 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.808936    7559 generic.go:356] "Generic (PLEG): container finished" podID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerID="fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca" exitCode=0
Oct 31 00:57:46.809168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.808975    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"
Oct 31 00:57:46.809168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.809014    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" event={"ID":"50475663-6c5f-4f5c-b405-595c5bca95f2","Type":"ContainerDied","Data":"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"}
Oct 31 00:57:46.809168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.809068    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77" event={"ID":"50475663-6c5f-4f5c-b405-595c5bca95f2","Type":"ContainerDied","Data":"a8d49afbd8e80533658b908236e61c1f2b9361dd72bcf6ce12b08da0b9b8ec02"}
Oct 31 00:57:46.809168 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.809091    7559 scope.go:122] "RemoveContainer" containerID="fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"
Oct 31 00:57:46.817807 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.817790    7559 scope.go:122] "RemoveContainer" containerID="fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"
Oct 31 00:57:46.818061 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:57:46.818044    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca\": container with ID starting with fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca not found: ID does not exist" containerID="fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"
Oct 31 00:57:46.818129 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.818070    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca"} err="failed to get container status \"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca\": rpc error: code = NotFound desc = could not find container \"fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca\": container with ID starting with fd30ed8870c9afcb5ceaba12861b5d31cee5e64f9c22017918a3ee98595caaca not found: ID does not exist"
Oct 31 00:57:46.965717 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.965685    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:57:46.971337 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:46.971303    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb6kmj77"]
Oct 31 00:57:47.778701 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:47.778672    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" path="/var/lib/kubelet/pods/50475663-6c5f-4f5c-b405-595c5bca95f2/volumes"
Oct 31 00:57:47.825194 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:47.825166    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:48.052051 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:48.051972    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:54.876551 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:54.876520    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:56.706923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.706881    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:57:56.707312 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.707258    7559 cpu_manager.go:414] "containerMap: removing container" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main"
Oct 31 00:57:56.707312 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.707270    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main"
Oct 31 00:57:56.707390 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.707343    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b686f81-17e5-448c-88fe-ab774306fcff" containerName="istio-proxy"
Oct 31 00:57:56.707390 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.707352    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="50475663-6c5f-4f5c-b405-595c5bca95f2" containerName="main"
Oct 31 00:57:56.711503 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.711483    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.808028 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.807992    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"kube-root-ca.crt\""
Oct 31 00:57:56.808183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.808057    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"openshift-service-ca.crt\""
Oct 31 00:57:56.808183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.808072    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"default-dockercfg-krfxs\""
Oct 31 00:57:56.808183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.808091    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Oct 31 00:57:56.809575 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.809549    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:57:56.858468 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.858438    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:56.872924 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.872905    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk94v\" (UniqueName: \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.873002 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.872962    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.873062 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.873040    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.873116 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.873090    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.873172 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.873157    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.873225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.873208    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974562 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974493    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974562 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974531    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974566    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974752 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974730    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk94v\" (UniqueName: \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974821    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.974872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974854    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.975001 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.974980    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.975060 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.975018    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.975163 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.975147    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.976763 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.976744    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:56.977277 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:56.977257    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:57.035307 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.035279    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk94v\" (UniqueName: \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:57.197704 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.197677    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:57:57.201332 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.201313    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.252449 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.252392    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-58989\""
Oct 31 00:57:57.258249 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.258220    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:57:57.277252 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.277228    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.277375 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.277261    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-276xs\" (UniqueName: \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.323462 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.323438    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:57.378312 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.378155    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.378977 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.378952    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-276xs\" (UniqueName: \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.381014 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.380968    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.384076 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.384022    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:57:57.439175 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.439147    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-276xs\" (UniqueName: \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.513582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.513518    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:57.693225 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.693192    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:57:57.700160 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:57:57.700136    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a37bc47_354a_4cf8_aaac_e80cdaa9ef43.slice/crio-53e9053c8099fb95503e88de0f28f1ffc7ee10c9562c2663b0c4a53e7f872fbc WatchSource:0}: Error finding container 53e9053c8099fb95503e88de0f28f1ffc7ee10c9562c2663b0c4a53e7f872fbc: Status 404 returned error can't find the container with id 53e9053c8099fb95503e88de0f28f1ffc7ee10c9562c2663b0c4a53e7f872fbc
Oct 31 00:57:57.854412 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.854322    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" event={"ID":"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43","Type":"ContainerStarted","Data":"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"}
Oct 31 00:57:57.854412 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.854378    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" event={"ID":"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43","Type":"ContainerStarted","Data":"53e9053c8099fb95503e88de0f28f1ffc7ee10c9562c2663b0c4a53e7f872fbc"}
Oct 31 00:57:57.884150 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.884119    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:57:57.890965 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:57:57.890935    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-cfd8957b852088051228c952935a6f9c21f63abac2bb70354db66a5a53139030 WatchSource:0}: Error finding container cfd8957b852088051228c952935a6f9c21f63abac2bb70354db66a5a53139030: Status 404 returned error can't find the container with id cfd8957b852088051228c952935a6f9c21f63abac2bb70354db66a5a53139030
Oct 31 00:57:57.967440 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:57.967384    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" podStartSLOduration=1.96737101 podStartE2EDuration="1.96737101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:57:57.967137356 +0000 UTC m=+1682.342032578" watchObservedRunningTime="2026-10-31 00:57:57.96737101 +0000 UTC m=+1682.342266222"
Oct 31 00:57:58.324463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:58.324431    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:57:58.859791 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:58.859757    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" event={"ID":"6f4561ad-74b5-4acd-b436-a8dc110eb1fd","Type":"ContainerStarted","Data":"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"}
Oct 31 00:57:58.860182 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:58.859802    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" event={"ID":"6f4561ad-74b5-4acd-b436-a8dc110eb1fd","Type":"ContainerStarted","Data":"cfd8957b852088051228c952935a6f9c21f63abac2bb70354db66a5a53139030"}
Oct 31 00:57:58.860182 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:58.859899    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:57:58.971386 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:57:58.971341    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podStartSLOduration=1.971326582 podStartE2EDuration="1.971326582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:57:58.970813571 +0000 UTC m=+1683.345708792" watchObservedRunningTime="2026-10-31 00:57:58.971326582 +0000 UTC m=+1683.346221799"
Oct 31 00:58:01.320920 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:01.320886    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:01.515852 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:01.515821    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:02.484785 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:02.484749    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:07.234500 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:58:07.234462    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:58:07.323698 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:07.323666    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:58:07.335774 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:07.335746    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:58:07.906880 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:07.906850    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:58:14.311361 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:14.311329    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:14.519416 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:14.519384    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:19.429190 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:19.429154    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:19.921297 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:19.921267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:21.944763 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:21.944729    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:24.472446 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:24.472413    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:28.232937 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:28.232904    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:28.434251 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:28.434211    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:29.864998 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:29.864971    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:58:37.131288 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.131253    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:58:37.141696 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:58:37.141646    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c" cmd=["/bin/sleep","15"]
Oct 31 00:58:37.141872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.141702    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 00:58:37.141872 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:58:37.141717    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerName="main" containerID="cri-o://3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"
Oct 31 00:58:37.141872 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.141777    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerName="main" containerID="cri-o://3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c" gracePeriod=60
Oct 31 00:58:37.152867 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.152843    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:58:37.196849 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.196821    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:37.233446 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:58:37.233414    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:58:37.390530 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.390455    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:37.483536 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.483510    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:58:37.611582 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611543    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\" (UniqueName: \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.611770 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611626    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.611770 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611669    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.611770 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611698    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.611770 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611759    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.612001 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611814    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\") pod \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\" (UID: \"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43\") "
Oct 31 00:58:37.612001 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.611923    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:58:37.612109 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.612043    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:58:37.612165 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.612108    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:37.612165 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.612124    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:58:37.614041 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.614014    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:58:37.614041 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.614031    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:58:37.614185 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.614021    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v" pod "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" (UID: "6a37bc47-354a-4cf8-aaac-e80cdaa9ef43"). InnerVolumeSpecName "kube-api-access-jk94v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:58:37.713040 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.713015    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:37.713040 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.713035    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:37.713177 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.713045    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:37.713177 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.713052    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:37.713177 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:37.713061    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk94v\" (UniqueName: \"kubernetes.io/projected/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43-kube-api-access-jk94v\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:58:38.026038 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.025953    7559 generic.go:356] "Generic (PLEG): container finished" podID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerID="3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c" exitCode=0
Oct 31 00:58:38.026038 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.025999    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"
Oct 31 00:58:38.026038 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.026022    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" event={"ID":"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43","Type":"ContainerDied","Data":"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"}
Oct 31 00:58:38.026284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.026062    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp" event={"ID":"6a37bc47-354a-4cf8-aaac-e80cdaa9ef43","Type":"ContainerDied","Data":"53e9053c8099fb95503e88de0f28f1ffc7ee10c9562c2663b0c4a53e7f872fbc"}
Oct 31 00:58:38.026284 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.026083    7559 scope.go:122] "RemoveContainer" containerID="3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"
Oct 31 00:58:38.034490 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.034468    7559 scope.go:122] "RemoveContainer" containerID="3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"
Oct 31 00:58:38.034778 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:58:38.034760    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c\": container with ID starting with 3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c not found: ID does not exist" containerID="3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"
Oct 31 00:58:38.034855 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.034792    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c"} err="failed to get container status \"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c\": rpc error: code = NotFound desc = could not find container \"3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c\": container with ID starting with 3c60ad9d68e4ff57bd9ac090823260539f9b0f268458b5a3a5fadd016071df9c not found: ID does not exist"
Oct 31 00:58:38.182686 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.182655    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:58:38.228727 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:38.228702    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc-router-managed-test-llm-e45d1f79-kserve-58fbd56d5-89plp"]
Oct 31 00:58:39.780011 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:39.779963    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" path="/var/lib/kubelet/pods/6a37bc47-354a-4cf8-aaac-e80cdaa9ef43/volumes"
Oct 31 00:58:39.864873 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:39.864838    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:58:48.300301 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:48.300267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:58:49.865256 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:49.865223    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:58:52.171616 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:52.171565    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" containerID="cri-o://bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459" gracePeriod=45
Oct 31 00:58:59.865269 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:59.865232    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:58:59.865656 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:58:59.865324    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:59:07.233422 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:07.233384    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:59:09.865156 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:09.865119    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:59:19.865302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:19.865266    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:59:22.289567 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:22.289482    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-conmon-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 00:59:22.289943 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:22.289730    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-conmon-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 00:59:22.290011 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:22.289959    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-conmon-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 00:59:22.295901 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:22.295775    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4561ad_74b5_4acd_b436_a8dc110eb1fd.slice/crio-conmon-bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 00:59:22.422579 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.422550    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:59:22.462378 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.462321    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\") pod \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") "
Oct 31 00:59:22.462378 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.462370    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\" (UniqueName: \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\") pod \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\" (UID: \"6f4561ad-74b5-4acd-b436-a8dc110eb1fd\") "
Oct 31 00:59:22.464528 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.464497    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs" pod "6f4561ad-74b5-4acd-b436-a8dc110eb1fd" (UID: "6f4561ad-74b5-4acd-b436-a8dc110eb1fd"). InnerVolumeSpecName "kube-api-access-276xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:59:22.464662 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.464518    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs" pod "6f4561ad-74b5-4acd-b436-a8dc110eb1fd" (UID: "6f4561ad-74b5-4acd-b436-a8dc110eb1fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:22.564008 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.563977    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:22.564008 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:22.564004    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-276xs\" (UniqueName: \"kubernetes.io/projected/6f4561ad-74b5-4acd-b436-a8dc110eb1fd-kube-api-access-276xs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:23.212334 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.212297    7559 generic.go:356] "Generic (PLEG): container finished" podID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerID="bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459" exitCode=0
Oct 31 00:59:23.212518 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.212349    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"
Oct 31 00:59:23.212518 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.212383    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" event={"ID":"6f4561ad-74b5-4acd-b436-a8dc110eb1fd","Type":"ContainerDied","Data":"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"}
Oct 31 00:59:23.212518 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.212438    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp" event={"ID":"6f4561ad-74b5-4acd-b436-a8dc110eb1fd","Type":"ContainerDied","Data":"cfd8957b852088051228c952935a6f9c21f63abac2bb70354db66a5a53139030"}
Oct 31 00:59:23.212518 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.212459    7559 scope.go:122] "RemoveContainer" containerID="bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"
Oct 31 00:59:23.221105 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.221086    7559 scope.go:122] "RemoveContainer" containerID="bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"
Oct 31 00:59:23.221334 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:23.221318    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459\": container with ID starting with bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459 not found: ID does not exist" containerID="bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"
Oct 31 00:59:23.221372 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.221344    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459"} err="failed to get container status \"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459\": rpc error: code = NotFound desc = could not find container \"bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459\": container with ID starting with bfc785ce3b7ae6274cbc1d8b57a7775cecdba91f86de6f3aead15e81232b9459 not found: ID does not exist"
Oct 31 00:59:23.368772 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.368749    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:59:23.415116 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.415086    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche9swqp"]
Oct 31 00:59:23.778717 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:23.778679    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" path="/var/lib/kubelet/pods/6f4561ad-74b5-4acd-b436-a8dc110eb1fd/volumes"
Oct 31 00:59:24.430909 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:24.430878    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:24.632302 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:24.632272    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:31.352716 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:31.352684    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:34.655418 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655383    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 00:59:34.655827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655712    7559 cpu_manager.go:414] "containerMap: removing container" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main"
Oct 31 00:59:34.655827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655723    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main"
Oct 31 00:59:34.655827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655737    7559 cpu_manager.go:414] "containerMap: removing container" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerName="main"
Oct 31 00:59:34.655827 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655742    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerName="main"
Oct 31 00:59:34.655963 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655830    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f4561ad-74b5-4acd-b436-a8dc110eb1fd" containerName="main"
Oct 31 00:59:34.655963 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.655839    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a37bc47-354a-4cf8-aaac-e80cdaa9ef43" containerName="main"
Oct 31 00:59:34.660180 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.660160    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.756727 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.756694    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Oct 31 00:59:34.756727 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.756708    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-87647\""
Oct 31 00:59:34.756906 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.756889    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\""
Oct 31 00:59:34.756955 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.756897    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\""
Oct 31 00:59:34.757990 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.757972    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 00:59:34.760351 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760332    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.760414 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760370    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4j2t\" (UniqueName: \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.760414 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760396    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.760531 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760514    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.760577 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760564    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.760669 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.760652    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.802148 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.802124    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:34.861706 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861685    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.861807 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861728    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.861807 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861744    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.861807 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861766    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.861807 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861803    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4j2t\" (UniqueName: \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.861986 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.861840    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.862105 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.862082    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.862169 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.862144    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.862235 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.862220    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.864183 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.864163    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.864318 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.864299    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.921308 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.921252    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4j2t\" (UniqueName: \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") " pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:34.971912 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:34.971889    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:35.162121 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.162087    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 00:59:35.166059 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.166038    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.216721 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.216700    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-6zpsh\""
Oct 31 00:59:35.222393 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.222367    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 00:59:35.265417 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.265394    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.265532 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.265513    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhq7\" (UniqueName: \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.338556 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.338500    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:35.342201 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.342178    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 00:59:35.348937 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:59:35.348909    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f71141_fc8f_4564_b442_0377405acbd3.slice/crio-31d3ec81ddcec06c4ea672d34929d437adaa5d5b7d6458f1462a477cb1facfa9 WatchSource:0}: Error finding container 31d3ec81ddcec06c4ea672d34929d437adaa5d5b7d6458f1462a477cb1facfa9: Status 404 returned error can't find the container with id 31d3ec81ddcec06c4ea672d34929d437adaa5d5b7d6458f1462a477cb1facfa9
Oct 31 00:59:35.366884 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.366827    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhq7\" (UniqueName: \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.366969 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.366912    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.369209 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.369192    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.426453 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.426390    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhq7\" (UniqueName: \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.477923 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.477893    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:35.845331 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:35.845257    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 00:59:35.852757 ip-10-0-143-57 kubenswrapper[7559]: W1031 00:59:35.852730    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be1f36e_b742_4889_80cd_41866026a725.slice/crio-03fc650738804cb381b68ff1c787e51cd1354af900f6da2dc841606cbd1e775c WatchSource:0}: Error finding container 03fc650738804cb381b68ff1c787e51cd1354af900f6da2dc841606cbd1e775c: Status 404 returned error can't find the container with id 03fc650738804cb381b68ff1c787e51cd1354af900f6da2dc841606cbd1e775c
Oct 31 00:59:36.269706 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.269669    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" event={"ID":"2be1f36e-b742-4889-80cd-41866026a725","Type":"ContainerStarted","Data":"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"}
Oct 31 00:59:36.269874 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.269727    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" event={"ID":"2be1f36e-b742-4889-80cd-41866026a725","Type":"ContainerStarted","Data":"03fc650738804cb381b68ff1c787e51cd1354af900f6da2dc841606cbd1e775c"}
Oct 31 00:59:36.269874 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.269769    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 00:59:36.271289 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.271268    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" event={"ID":"d1f71141-fc8f-4564-b442-0377405acbd3","Type":"ContainerStarted","Data":"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"}
Oct 31 00:59:36.271380 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.271301    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" event={"ID":"d1f71141-fc8f-4564-b442-0377405acbd3","Type":"ContainerStarted","Data":"31d3ec81ddcec06c4ea672d34929d437adaa5d5b7d6458f1462a477cb1facfa9"}
Oct 31 00:59:36.380384 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.380327    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podStartSLOduration=1.380315493 podStartE2EDuration="1.380315493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:59:36.380252453 +0000 UTC m=+1780.755147672" watchObservedRunningTime="2026-10-31 00:59:36.380315493 +0000 UTC m=+1780.755210713"
Oct 31 00:59:36.493724 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.493657    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" podStartSLOduration=2.493638667 podStartE2EDuration="2.493638667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:59:36.492624688 +0000 UTC m=+1780.867519910" watchObservedRunningTime="2026-10-31 00:59:36.493638667 +0000 UTC m=+1780.868533889"
Oct 31 00:59:36.972685 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:36.972656    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:37.234413 ip-10-0-143-57 kubenswrapper[7559]: E1031 00:59:37.234336    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 00:59:37.828559 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:37.828518    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:38.057454 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:38.057421    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:40.754211 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:40.754180    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 00:59:44.972463 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:44.972413    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:44.984568 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:44.984539    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:45.318153 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:45.318071    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 00:59:48.623978 ip-10-0-143-57 kubenswrapper[7559]: I1031 00:59:48.623940    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:07.233810 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:00:07.233728    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:00:07.276628 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:07.276592    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 01:00:15.507956 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.507905    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:15.912992 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.912960    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:00:15.916132 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.916109    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:15.992009 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.991984    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Oct 31 01:00:15.994305 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.994282    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:15.994409 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:15.994395    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdj2\" (UniqueName: \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.012588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.012565    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-pz5c5\""
Oct 31 01:00:16.013499 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.013478    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:00:16.085162 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.085126    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:16.095451 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.095424    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdj2\" (UniqueName: \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.095547 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.095468    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.097962 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.097944    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.155998 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.155974    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdj2\" (UniqueName: \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.228284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.228232    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:16.596718 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:16.596647    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:00:16.604116 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:00:16.604088    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f4b38b_9ddd_47d3_aeff_2c50b9a325a2.slice/crio-32df62745135730d3410e0a78f152659070f064d0ea22c6e1fdf3634cddf8378 WatchSource:0}: Error finding container 32df62745135730d3410e0a78f152659070f064d0ea22c6e1fdf3634cddf8378: Status 404 returned error can't find the container with id 32df62745135730d3410e0a78f152659070f064d0ea22c6e1fdf3634cddf8378
Oct 31 01:00:17.446236 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:17.446197    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" event={"ID":"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2","Type":"ContainerStarted","Data":"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"}
Oct 31 01:00:17.446413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:17.446257    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" event={"ID":"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2","Type":"ContainerStarted","Data":"32df62745135730d3410e0a78f152659070f064d0ea22c6e1fdf3634cddf8378"}
Oct 31 01:00:17.446413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:17.446287    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:17.558495 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:17.558446    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podStartSLOduration=2.558427876 podStartE2EDuration="2.558427876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:00:17.557581285 +0000 UTC m=+1821.932476506" watchObservedRunningTime="2026-10-31 01:00:17.558427876 +0000 UTC m=+1821.933323088"
Oct 31 01:00:21.029396 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:21.029351    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:21.229328 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:21.229294    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:25.184315 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:25.184281    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:37.233989 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:00:37.233946    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:00:48.452268 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:48.452233    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:00:49.038309 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:49.038263    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:55.486149 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:55.486119    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:00:55.539983 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:55.539942    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:55.730328 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:55.730299    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:00:58.452619 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:00:58.452569    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:07.234050 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:07.234011    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:01:07.720992 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:07.720965    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:07.920825 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:07.920793    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:08.387046 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:08.387011    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:08.452969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:08.452939    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:08.580561 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:08.580483    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:10.506006 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:10.505970    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" containerID="cri-o://10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625" gracePeriod=45
Oct 31 01:01:12.509731 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:12.509698    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:14.602997 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:14.602967    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:17.643927 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:17.643893    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:18.453139 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:18.453106    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:18.453333 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:18.453215    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:01:20.963415 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:20.963378    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:21.167307 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:21.167255    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:28.452287 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:28.452252    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:37.234064 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:37.234021    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:01:38.452748 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:38.452709    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:40.741247 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.741216    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:01:40.783623 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.783550    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\" (UniqueName: \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\") pod \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") "
Oct 31 01:01:40.783623 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.783582    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\" (UniqueName: \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\") pod \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\" (UID: \"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2\") "
Oct 31 01:01:40.785883 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.785849    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs" pod "01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" (UID: "01f4b38b-9ddd-47d3-aeff-2c50b9a325a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:40.785883 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.785867    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2" pod "01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" (UID: "01f4b38b-9ddd-47d3-aeff-2c50b9a325a2"). InnerVolumeSpecName "kube-api-access-vfdj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:40.800006 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.799980    7559 generic.go:356] "Generic (PLEG): container finished" podID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerID="10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625" exitCode=0
Oct 31 01:01:40.800125 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.800022    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"
Oct 31 01:01:40.800125 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.800059    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" event={"ID":"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2","Type":"ContainerDied","Data":"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"}
Oct 31 01:01:40.800125 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.800123    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l" event={"ID":"01f4b38b-9ddd-47d3-aeff-2c50b9a325a2","Type":"ContainerDied","Data":"32df62745135730d3410e0a78f152659070f064d0ea22c6e1fdf3634cddf8378"}
Oct 31 01:01:40.800296 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.800153    7559 scope.go:122] "RemoveContainer" containerID="10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"
Oct 31 01:01:40.808771 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.808751    7559 scope.go:122] "RemoveContainer" containerID="10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"
Oct 31 01:01:40.809012 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:40.808991    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625\": container with ID starting with 10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625 not found: ID does not exist" containerID="10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"
Oct 31 01:01:40.809076 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.809024    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625"} err="failed to get container status \"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625\": rpc error: code = NotFound desc = could not find container \"10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625\": container with ID starting with 10dc246b38fdb6618fe0f988104e66f5ecbb4d7713dadcda036e9612bf721625 not found: ID does not exist"
Oct 31 01:01:40.885208 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.885177    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfdj2\" (UniqueName: \"kubernetes.io/projected/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-kube-api-access-vfdj2\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:40.885208 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.885204    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:40.960384 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.960351    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:01:40.966449 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:40.966423    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevng9l"]
Oct 31 01:01:41.779159 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:41.779126    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" path="/var/lib/kubelet/pods/01f4b38b-9ddd-47d3-aeff-2c50b9a325a2/volumes"
Oct 31 01:01:44.394711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.394680    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 01:01:44.399715 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.399685    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 01:01:44.409789 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:44.409740    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3" cmd=["/bin/sleep","15"]
Oct 31 01:01:44.409917 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.409811    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 01:01:44.409917 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:44.409825    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" containerName="main" containerID="cri-o://9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"
Oct 31 01:01:44.409917 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.409867    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" containerName="main" containerID="cri-o://9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3" gracePeriod=60
Oct 31 01:01:44.560684 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.560652    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:44.745225 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.745202    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 01:01:44.768672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.768644    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:44.818736 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.818698    7559 generic.go:356] "Generic (PLEG): container finished" podID="d1f71141-fc8f-4564-b442-0377405acbd3" containerID="9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3" exitCode=0
Oct 31 01:01:44.818943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.818773    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" event={"ID":"d1f71141-fc8f-4564-b442-0377405acbd3","Type":"ContainerDied","Data":"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"}
Oct 31 01:01:44.818943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.818867    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw" event={"ID":"d1f71141-fc8f-4564-b442-0377405acbd3","Type":"ContainerDied","Data":"31d3ec81ddcec06c4ea672d34929d437adaa5d5b7d6458f1462a477cb1facfa9"}
Oct 31 01:01:44.818943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.818905    7559 scope.go:122] "RemoveContainer" containerID="9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"
Oct 31 01:01:44.819103 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.819075    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"
Oct 31 01:01:44.824464 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824438    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824652 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824480    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824652 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824505    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824652 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824646    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\" (UniqueName: \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824680    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824739    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\") pod \"d1f71141-fc8f-4564-b442-0377405acbd3\" (UID: \"d1f71141-fc8f-4564-b442-0377405acbd3\") "
Oct 31 01:01:44.824818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.824808    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:44.825095 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.825022    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:44.825275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.825177    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:44.825275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.825100    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:44.827120 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.827099    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:44.827461 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.827440    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:44.827523 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.827485    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t" pod "d1f71141-fc8f-4564-b442-0377405acbd3" (UID: "d1f71141-fc8f-4564-b442-0377405acbd3"). InnerVolumeSpecName "kube-api-access-n4j2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:44.843503 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.843476    7559 scope.go:122] "RemoveContainer" containerID="9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"
Oct 31 01:01:44.843823 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:01:44.843802    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3\": container with ID starting with 9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3 not found: ID does not exist" containerID="9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"
Oct 31 01:01:44.843884 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.843833    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3"} err="failed to get container status \"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3\": rpc error: code = NotFound desc = could not find container \"9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3\": container with ID starting with 9033c1b35c65d2bf142471f38c83de3f013416d3f58a6292f4d11cd85aa447d3 not found: ID does not exist"
Oct 31 01:01:44.926576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.926492    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:44.926576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.926523    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:44.926576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.926534    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4j2t\" (UniqueName: \"kubernetes.io/projected/d1f71141-fc8f-4564-b442-0377405acbd3-kube-api-access-n4j2t\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:44.926576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.926545    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f71141-fc8f-4564-b442-0377405acbd3-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:44.926576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:44.926553    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f71141-fc8f-4564-b442-0377405acbd3-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:45.239031 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:45.238944    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 01:01:45.245806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:45.245780    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvc-router-managed-test-llm-5b1e8f15-kserve-5957d558489t9zw"]
Oct 31 01:01:45.781645 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:45.781590    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" path="/var/lib/kubelet/pods/d1f71141-fc8f-4564-b442-0377405acbd3/volumes"
Oct 31 01:01:47.277753 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:47.277709    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:49.312716 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:49.312682    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:01:57.277479 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:57.277442    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:01:59.415388 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:01:59.415347    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" containerID="cri-o://51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7" gracePeriod=45
Oct 31 01:02:07.233975 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:02:07.233939    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:02:07.277368 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:07.277339    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:02:07.277532 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:07.277468    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 01:02:17.277257 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:17.277220    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:02:27.277281 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:27.277244    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:02:29.669883 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.669854    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 01:02:29.702515 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.702437    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\" (UniqueName: \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\") pod \"2be1f36e-b742-4889-80cd-41866026a725\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") "
Oct 31 01:02:29.702693 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.702536    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\" (UniqueName: \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\") pod \"2be1f36e-b742-4889-80cd-41866026a725\" (UID: \"2be1f36e-b742-4889-80cd-41866026a725\") "
Oct 31 01:02:29.704787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.704746    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs" pod "2be1f36e-b742-4889-80cd-41866026a725" (UID: "2be1f36e-b742-4889-80cd-41866026a725"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:02:29.704938 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.704914    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7" pod "2be1f36e-b742-4889-80cd-41866026a725" (UID: "2be1f36e-b742-4889-80cd-41866026a725"). InnerVolumeSpecName "kube-api-access-qfhq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:02:29.803501 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.803458    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfhq7\" (UniqueName: \"kubernetes.io/projected/2be1f36e-b742-4889-80cd-41866026a725-kube-api-access-qfhq7\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:02:29.803672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:29.803507    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2be1f36e-b742-4889-80cd-41866026a725-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:02:30.002448 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.002361    7559 generic.go:356] "Generic (PLEG): container finished" podID="2be1f36e-b742-4889-80cd-41866026a725" containerID="51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7" exitCode=0
Oct 31 01:02:30.002448 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.002427    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"
Oct 31 01:02:30.002723 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.002456    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" event={"ID":"2be1f36e-b742-4889-80cd-41866026a725","Type":"ContainerDied","Data":"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"}
Oct 31 01:02:30.002723 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.002522    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p" event={"ID":"2be1f36e-b742-4889-80cd-41866026a725","Type":"ContainerDied","Data":"03fc650738804cb381b68ff1c787e51cd1354af900f6da2dc841606cbd1e775c"}
Oct 31 01:02:30.002723 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.002550    7559 scope.go:122] "RemoveContainer" containerID="51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"
Oct 31 01:02:30.010740 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.010713    7559 scope.go:122] "RemoveContainer" containerID="51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"
Oct 31 01:02:30.010982 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:02:30.010956    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7\": container with ID starting with 51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7 not found: ID does not exist" containerID="51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"
Oct 31 01:02:30.011088 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.010987    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7"} err="failed to get container status \"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7\": rpc error: code = NotFound desc = could not find container \"51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7\": container with ID starting with 51c672316977588a7b90fbd8f82f8935f1584cfe85c83b0178ec002c79b4a6b7 not found: ID does not exist"
Oct 31 01:02:30.164758 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.164724    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 01:02:30.170297 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:30.170273    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherss8p"]
Oct 31 01:02:31.778057 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:31.778023    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2be1f36e-b742-4889-80cd-41866026a725" path="/var/lib/kubelet/pods/2be1f36e-b742-4889-80cd-41866026a725/volumes"
Oct 31 01:02:32.848664 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:32.848628    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:33.852687 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:33.852654    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:34.054511 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:34.054482    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:37.117734 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:37.117686    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:37.233451 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:02:37.233418    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:02:37.331797 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:37.331760    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:42.140092 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:42.140053    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:42.342813 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:42.342779    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:44.711463 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:44.711422    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:45.256450 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:45.256416    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:48.764414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:48.764379    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:48.962401 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:48.962353    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:49.649143 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:49.649071    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:54.613828 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.613796    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614127    7559 cpu_manager.go:414] "containerMap: removing container" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main"
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614139    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main"
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614158    7559 cpu_manager.go:414] "containerMap: removing container" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" containerName="main"
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614163    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" containerName="main"
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614179    7559 cpu_manager.go:414] "containerMap: removing container" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main"
Oct 31 01:02:54.614212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614185    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main"
Oct 31 01:02:54.614395 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614250    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="2be1f36e-b742-4889-80cd-41866026a725" containerName="main"
Oct 31 01:02:54.614395 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614258    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="01f4b38b-9ddd-47d3-aeff-2c50b9a325a2" containerName="main"
Oct 31 01:02:54.614395 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.614265    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1f71141-fc8f-4564-b442-0377405acbd3" containerName="main"
Oct 31 01:02:54.616989 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.616970    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705694 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705664    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8npkz\" (UniqueName: \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705817 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705731    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705864 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705820    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705864 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705859    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705877    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.705947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.705896    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.713376 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.713347    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Oct 31 01:02:54.713376 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.713355    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\""
Oct 31 01:02:54.713520 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.713463    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-tcfbx\""
Oct 31 01:02:54.713653 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.713639    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\""
Oct 31 01:02:54.715083 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.715067    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:02:54.757376 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.757321    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:54.806536 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806511    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806664 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806537    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806664 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806554    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806664 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806587    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8npkz\" (UniqueName: \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806810 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806678    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806810 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806721    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.806958 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.806940    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.807021 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.807001    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.807140 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.807119    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.808963 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.808944    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.809144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.809130    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.866006 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.865953    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8npkz\" (UniqueName: \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:54.928809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:54.928785    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:55.074616 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.074560    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:55.219832 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.219801    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:02:55.223995 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.223977    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.274871 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.274843    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-tllj9\""
Oct 31 01:02:55.279807 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.279778    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:02:55.311010 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.310984    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.311114 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.311019    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpkl2\" (UniqueName: \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.337110 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.337083    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:02:55.344883 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:02:55.344859    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b57c6b_6357_4593_9d6e_76e2b00e1c98.slice/crio-915a5807833b08cbd41d318cecb789772c49c6bffc3a6dfdedd840b6dcac56da WatchSource:0}: Error finding container 915a5807833b08cbd41d318cecb789772c49c6bffc3a6dfdedd840b6dcac56da: Status 404 returned error can't find the container with id 915a5807833b08cbd41d318cecb789772c49c6bffc3a6dfdedd840b6dcac56da
Oct 31 01:02:55.372029 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.371978    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:02:55.412409 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.412386    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.412526 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.412423    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpkl2\" (UniqueName: \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.414728 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.414709    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.472111 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.472056    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpkl2\" (UniqueName: \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.536890 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.536862    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:55.916031 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:55.916000    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:02:55.923944 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:02:55.923903    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8edb38_15f2_47d3_a679_ae08a3183d9c.slice/crio-6ec928a6c68945fc41229d657a78521f823c07b6b1463fa82afe49b32f7c8bdc WatchSource:0}: Error finding container 6ec928a6c68945fc41229d657a78521f823c07b6b1463fa82afe49b32f7c8bdc: Status 404 returned error can't find the container with id 6ec928a6c68945fc41229d657a78521f823c07b6b1463fa82afe49b32f7c8bdc
Oct 31 01:02:56.108057 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.108022    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" event={"ID":"db8edb38-15f2-47d3-a679-ae08a3183d9c","Type":"ContainerStarted","Data":"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"}
Oct 31 01:02:56.108171 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.108075    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" event={"ID":"db8edb38-15f2-47d3-a679-ae08a3183d9c","Type":"ContainerStarted","Data":"6ec928a6c68945fc41229d657a78521f823c07b6b1463fa82afe49b32f7c8bdc"}
Oct 31 01:02:56.108171 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.108102    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:02:56.109466 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.109442    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" event={"ID":"36b57c6b-6357-4593-9d6e-76e2b00e1c98","Type":"ContainerStarted","Data":"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"}
Oct 31 01:02:56.109567 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.109489    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" event={"ID":"36b57c6b-6357-4593-9d6e-76e2b00e1c98","Type":"ContainerStarted","Data":"915a5807833b08cbd41d318cecb789772c49c6bffc3a6dfdedd840b6dcac56da"}
Oct 31 01:02:56.220321 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.220241    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podStartSLOduration=1.220230546 podStartE2EDuration="1.220230546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:56.219844525 +0000 UTC m=+1980.594739749" watchObservedRunningTime="2026-10-31 01:02:56.220230546 +0000 UTC m=+1980.595125766"
Oct 31 01:02:56.332214 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.332172    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" podStartSLOduration=2.332159555 podStartE2EDuration="2.332159555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:56.33113721 +0000 UTC m=+1980.706032447" watchObservedRunningTime="2026-10-31 01:02:56.332159555 +0000 UTC m=+1980.707054776"
Oct 31 01:02:56.929120 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:56.929088    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:02:59.790655 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:02:59.790626    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:03.719125 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:03.719047    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:04.929797 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:04.929758    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:03:04.941438 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:04.941420    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:03:05.156926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:05.156894    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:03:05.405233 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:05.405203    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:06.048147 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:06.048112    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:07.234264 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:03:07.234229    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:03:11.784497 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:11.784464    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:20.736643 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:20.736585    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:26.000834 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.000799    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:03:26.004134 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.004117    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057517 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057492    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057523    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057548    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057617    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057783 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057693    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057783 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057710    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057783 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057752    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqsg5\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057871 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057842    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.057906 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.057875    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159064 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159036    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqsg5\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159066    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159088    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159133    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159165    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159387 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159209    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159387 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159237    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159387 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159281    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159542 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159437    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159542 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159451    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159542 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159530    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159761 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159569    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.159961 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.159926    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.160111 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.160077    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.161789 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.161768    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.161993 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.161976    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.212349 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.212322    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:03:26.220443 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.220416    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqsg5\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.220557 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.220497    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-k9d69\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.315579 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.315525    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:26.740089 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.740058    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:03:26.746871 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:03:26.746844    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d261c5a_28d5_4b54_a5c0_ad732654b0d5.slice/crio-bc3897898c52754c3547be9722b528bc6e34272a1b9e9443e7c2f487931e5512 WatchSource:0}: Error finding container bc3897898c52754c3547be9722b528bc6e34272a1b9e9443e7c2f487931e5512: Status 404 returned error can't find the container with id bc3897898c52754c3547be9722b528bc6e34272a1b9e9443e7c2f487931e5512
Oct 31 01:03:26.748841 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.748814    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:26.748910 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.748873    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:26.748910 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:26.748901    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:27.115889 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.115807    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:03:27.243627 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.239550    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" event={"ID":"4d261c5a-28d5-4b54-a5c0-ad732654b0d5","Type":"ContainerStarted","Data":"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"}
Oct 31 01:03:27.243627 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.239631    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" event={"ID":"4d261c5a-28d5-4b54-a5c0-ad732654b0d5","Type":"ContainerStarted","Data":"bc3897898c52754c3547be9722b528bc6e34272a1b9e9443e7c2f487931e5512"}
Oct 31 01:03:27.316503 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.316472    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:27.317562 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.317533    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 31 01:03:27.317716 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.317614    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 31 01:03:27.359331 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:27.359265    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podStartSLOduration=2.359247878 podStartE2EDuration="2.359247878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:03:27.358586588 +0000 UTC m=+2011.733481806" watchObservedRunningTime="2026-10-31 01:03:27.359247878 +0000 UTC m=+2011.734143100"
Oct 31 01:03:28.077980 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:28.077946    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:28.297014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:28.296980    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:28.316103 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:28.316078    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 31 01:03:28.316223 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:28.316132    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 31 01:03:29.316111 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:29.316081    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 31 01:03:29.316496 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:29.316135    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 31 01:03:30.316845 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:30.316808    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 31 01:03:30.317267 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:30.316863    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 31 01:03:31.316318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:31.316287    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 31 01:03:31.316484 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:31.316338    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 31 01:03:32.392533 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:32.392497    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:32.393007 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:32.392885    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:32.393560 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:32.393545    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:03:37.235122 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:03:37.235082    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:03:38.913081 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:38.913046    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:39.425178 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:39.425145    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:41.131354 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.131324    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:03:41.134915 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.134896    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192216 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192188    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnpp\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192271    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192294    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192432 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192382    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192487 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192436    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192487 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192473    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192619 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192491    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192619 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192571    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.192726 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.192627    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.229218 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.229194    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:03:41.293374 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293344    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293490 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293384    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293490 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293420    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293490 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293435    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293665 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293633    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293687    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293779 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293755    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnpp\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293840 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293816    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293896 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293847    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.293947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293921    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.294017 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.293996    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.294072 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.294027    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.294143 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.294122    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.294482 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.294461    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.296323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.296304    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.296454 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.296438    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.352947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.352924    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.353153 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.353132    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnpp\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\") pod \"openshift-ai-inference-openshift-default-568c495856-t4bb8\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.447426 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.447406    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:41.877249 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.877155    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:03:41.880367 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:03:41.880336    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c91d71_b5de_4b03_b7dd_af6c7dfd9537.slice/crio-947e59e120ebae1283ffc6248a2f44184865cd1ee76ee4fb8cb2556e9405f0c0 WatchSource:0}: Error finding container 947e59e120ebae1283ffc6248a2f44184865cd1ee76ee4fb8cb2556e9405f0c0: Status 404 returned error can't find the container with id 947e59e120ebae1283ffc6248a2f44184865cd1ee76ee4fb8cb2556e9405f0c0
Oct 31 01:03:41.882280 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.882248    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:41.882362 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.882306    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:41.882362 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:41.882332    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:03:42.308450 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.308412    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" event={"ID":"56c91d71-b5de-4b03-b7dd-af6c7dfd9537","Type":"ContainerStarted","Data":"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"}
Oct 31 01:03:42.308923 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.308464    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" event={"ID":"56c91d71-b5de-4b03-b7dd-af6c7dfd9537","Type":"ContainerStarted","Data":"947e59e120ebae1283ffc6248a2f44184865cd1ee76ee4fb8cb2556e9405f0c0"}
Oct 31 01:03:42.448098 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.448000    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:42.450345 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.450047    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:42.450345 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.450101    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:42.472640 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:42.472556    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podStartSLOduration=1.472539391 podStartE2EDuration="1.472539391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:03:42.472436862 +0000 UTC m=+2026.847332084" watchObservedRunningTime="2026-10-31 01:03:42.472539391 +0000 UTC m=+2026.847434617"
Oct 31 01:03:43.447999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:43.447961    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:43.448573 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:43.448544    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:44.448010 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:44.447971    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:44.448623 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:44.448565    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:44.683498 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:44.683473    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:45.450012 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:45.449974    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:45.450501 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:45.450042    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:46.450219 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:46.449921    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:46.450219 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:46.449982    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:47.447991 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:47.447951    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 31 01:03:47.448282 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:47.448248    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 31 01:03:48.452344 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:48.452314    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:48.452763 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:48.452568    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:48.453291 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:48.453273    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:03:50.001338 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:50.001307    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:03:51.099967 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:03:51.099931    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:07.234900 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:04:07.234859    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:04:19.290241 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:19.290207    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:19.498403 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:19.498365    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:26.362522 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:26.362482    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:37.235058 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:04:37.235009    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:04:43.086787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:43.086702    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:43.317793 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:43.317756    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:04:50.303087 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:04:50.303056    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:07.234452 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:07.234416    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:05:07.580638 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.580540    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:05:07.581835 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.581807    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:05:07.589652 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:07.589618    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed" cmd=["/bin/sleep","15"]
Oct 31 01:05:07.589769 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.589667    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 01:05:07.589769 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:07.589682    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerName="main" containerID="cri-o://50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"
Oct 31 01:05:07.589769 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.589714    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerName="main" containerID="cri-o://50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed" gracePeriod=60
Oct 31 01:05:07.648864 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.648834    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:07.840700 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.840646    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:05:07.846692 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.846661    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:07.878937 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.878916    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.878997    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\" (UniqueName: \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879032    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879207 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879057    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879207 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879097    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879313 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879184    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:05:07.879313 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879217    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\" (UniqueName: \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\") pod \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\" (UID: \"36b57c6b-6357-4593-9d6e-76e2b00e1c98\") "
Oct 31 01:05:07.879313 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879267    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:05:07.879449 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879338    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:05:07.879502 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879471    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:07.879502 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879489    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:07.879572 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.879502    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:07.881296 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.881269    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "kube-api-access-8npkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:05:07.881401 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.881326    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:05:07.881401 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.881349    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm" pod "36b57c6b-6357-4593-9d6e-76e2b00e1c98" (UID: "36b57c6b-6357-4593-9d6e-76e2b00e1c98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:05:07.979921 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.979894    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b57c6b-6357-4593-9d6e-76e2b00e1c98-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:07.979921 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.979918    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8npkz\" (UniqueName: \"kubernetes.io/projected/36b57c6b-6357-4593-9d6e-76e2b00e1c98-kube-api-access-8npkz\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:07.980054 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:07.979927    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b57c6b-6357-4593-9d6e-76e2b00e1c98-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:08.703885 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.703850    7559 generic.go:356] "Generic (PLEG): container finished" podID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerID="50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed" exitCode=0
Oct 31 01:05:08.704318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.703897    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"
Oct 31 01:05:08.704318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.703934    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" event={"ID":"36b57c6b-6357-4593-9d6e-76e2b00e1c98","Type":"ContainerDied","Data":"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"}
Oct 31 01:05:08.704318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.703987    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88" event={"ID":"36b57c6b-6357-4593-9d6e-76e2b00e1c98","Type":"ContainerDied","Data":"915a5807833b08cbd41d318cecb789772c49c6bffc3a6dfdedd840b6dcac56da"}
Oct 31 01:05:08.704318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.704010    7559 scope.go:122] "RemoveContainer" containerID="50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"
Oct 31 01:05:08.713394 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.713379    7559 scope.go:122] "RemoveContainer" containerID="50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"
Oct 31 01:05:08.713678 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:08.713660    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed\": container with ID starting with 50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed not found: ID does not exist" containerID="50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"
Oct 31 01:05:08.713738 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.713688    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed"} err="failed to get container status \"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed\": rpc error: code = NotFound desc = could not find container \"50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed\": container with ID starting with 50984c8967dca6d472bf420f56cff21372a3521e60ec7a3c9bee2fea301d2fed not found: ID does not exist"
Oct 31 01:05:08.861178 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.861152    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:05:08.907284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:08.907257    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc-router-managed-test-llm-4b931143-kserve-f966769b4-tnz88"]
Oct 31 01:05:09.778577 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:09.778542    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" path="/var/lib/kubelet/pods/36b57c6b-6357-4593-9d6e-76e2b00e1c98/volumes"
Oct 31 01:05:17.115814 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:17.115780    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:05:22.600579 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:22.600517    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main" containerID="cri-o://aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533" gracePeriod=45
Oct 31 01:05:27.115826 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:27.115785    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:05:32.540414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:32.540383    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:32.793545 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:32.793470    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:37.115851 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:37.115816    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:05:37.116216 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:37.115917    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:05:37.234195 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:37.234165    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:05:38.543729 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:38.543696    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:39.026710 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:39.026671    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:40.050576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:40.050546    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:44.632141 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:44.632106    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:45.470175 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:45.470135    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:46.604616 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:46.604561    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:46.799188 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:46.799149    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:47.115800 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:47.115760    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:05:50.695190 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:50.695155    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:52.836819 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.836795    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:05:52.847811 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.847789    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\") pod \"db8edb38-15f2-47d3-a679-ae08a3183d9c\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") "
Oct 31 01:05:52.847909 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.847830    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\" (UniqueName: \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\") pod \"db8edb38-15f2-47d3-a679-ae08a3183d9c\" (UID: \"db8edb38-15f2-47d3-a679-ae08a3183d9c\") "
Oct 31 01:05:52.849949 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.849922    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs" pod "db8edb38-15f2-47d3-a679-ae08a3183d9c" (UID: "db8edb38-15f2-47d3-a679-ae08a3183d9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:05:52.850045 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.849965    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2" pod "db8edb38-15f2-47d3-a679-ae08a3183d9c" (UID: "db8edb38-15f2-47d3-a679-ae08a3183d9c"). InnerVolumeSpecName "kube-api-access-zpkl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:05:52.888717 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.888662    7559 generic.go:356] "Generic (PLEG): container finished" podID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerID="aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533" exitCode=0
Oct 31 01:05:52.888717 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.888700    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"
Oct 31 01:05:52.888829 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.888749    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" event={"ID":"db8edb38-15f2-47d3-a679-ae08a3183d9c","Type":"ContainerDied","Data":"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"}
Oct 31 01:05:52.888829 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.888801    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2" event={"ID":"db8edb38-15f2-47d3-a679-ae08a3183d9c","Type":"ContainerDied","Data":"6ec928a6c68945fc41229d657a78521f823c07b6b1463fa82afe49b32f7c8bdc"}
Oct 31 01:05:52.888829 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.888822    7559 scope.go:122] "RemoveContainer" containerID="aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"
Oct 31 01:05:52.897725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.897707    7559 scope.go:122] "RemoveContainer" containerID="aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"
Oct 31 01:05:52.898010 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:05:52.897989    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533\": container with ID starting with aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533 not found: ID does not exist" containerID="aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"
Oct 31 01:05:52.898063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.898018    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533"} err="failed to get container status \"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533\": rpc error: code = NotFound desc = could not find container \"aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533\": container with ID starting with aeb2a3021ec41bcea9f31ea5e151ee84747293a8e6543dec26ccdc83c783f533 not found: ID does not exist"
Oct 31 01:05:52.948414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.948391    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db8edb38-15f2-47d3-a679-ae08a3183d9c-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:52.948414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:52.948412    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpkl2\" (UniqueName: \"kubernetes.io/projected/db8edb38-15f2-47d3-a679-ae08a3183d9c-kube-api-access-zpkl2\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:05:53.055858 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:53.055831    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:05:53.064004 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:53.063976    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schejh5j2"]
Oct 31 01:05:53.778543 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:53.778506    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" path="/var/lib/kubelet/pods/db8edb38-15f2-47d3-a679-ae08a3183d9c/volumes"
Oct 31 01:05:57.038126 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:57.038096    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:05:57.234751 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:05:57.234716    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:02.615994 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:02.615960    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:03.057928 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.057898    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:06:03.058236 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058224    7559 cpu_manager.go:414] "containerMap: removing container" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main"
Oct 31 01:06:03.058278 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058237    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main"
Oct 31 01:06:03.058278 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058268    7559 cpu_manager.go:414] "containerMap: removing container" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerName="main"
Oct 31 01:06:03.058278 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058272    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerName="main"
Oct 31 01:06:03.058374 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058320    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="db8edb38-15f2-47d3-a679-ae08a3183d9c" containerName="main"
Oct 31 01:06:03.058374 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.058332    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="36b57c6b-6357-4593-9d6e-76e2b00e1c98" containerName="main"
Oct 31 01:06:03.062774 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.062754    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.133737 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.133705    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfpc\" (UniqueName: \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.133868 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.133820    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.146860 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.146836    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\""
Oct 31 01:06:03.146860 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.146836    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-x6tk9\""
Oct 31 01:06:03.149575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.149559    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Oct 31 01:06:03.159186 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.159167    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\""
Oct 31 01:06:03.159279 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.159178    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-6gd2n\""
Oct 31 01:06:03.160220 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.160202    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:06:03.208387 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.208361    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:03.234697 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.234674    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.234797 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.234725    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfpc\" (UniqueName: \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.237176 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.237159    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.294653 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.294632    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfpc\" (UniqueName: \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.375410 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.375342    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:03.748927 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.748855    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:06:03.756389 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:06:03.756359    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a24379_f85d_422e_9973_b558504910fa.slice/crio-7d05087fa208bf1ed9ad6424d9a895594d9c5a1e0dccaf7fab17fa7382eeeb74 WatchSource:0}: Error finding container 7d05087fa208bf1ed9ad6424d9a895594d9c5a1e0dccaf7fab17fa7382eeeb74: Status 404 returned error can't find the container with id 7d05087fa208bf1ed9ad6424d9a895594d9c5a1e0dccaf7fab17fa7382eeeb74
Oct 31 01:06:03.942834 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.942798    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" event={"ID":"a9a24379-f85d-422e-9973-b558504910fa","Type":"ContainerStarted","Data":"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"}
Oct 31 01:06:03.942993 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.942855    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" event={"ID":"a9a24379-f85d-422e-9973-b558504910fa","Type":"ContainerStarted","Data":"7d05087fa208bf1ed9ad6424d9a895594d9c5a1e0dccaf7fab17fa7382eeeb74"}
Oct 31 01:06:03.942993 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:03.942884    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:04.059036 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:04.058934    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podStartSLOduration=1.058918341 podStartE2EDuration="1.058918341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:06:04.058580623 +0000 UTC m=+2168.433475844" watchObservedRunningTime="2026-10-31 01:06:04.058918341 +0000 UTC m=+2168.433813563"
Oct 31 01:06:05.376135 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:05.376089    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:07.234581 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:06:07.234542    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:06:10.604297 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:10.604257    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:11.749458 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:11.749421    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:12.033453 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:12.033369    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:06:34.948972 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:34.948944    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:06:37.234192 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:06:37.234152    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:06:50.985966 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:06:50.985924    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:07.235155 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:07:07.235116    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:07:37.233562 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:07:37.233523    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:07:48.136482 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:48.136432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:48.339763 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:48.339705    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:51.323566 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:51.323534    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:52.137070 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:52.137040    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:07:52.243498 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:52.243444    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:52.479844 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:52.479795    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:07:54.948724 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:07:54.948688    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:08:04.949125 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:04.949084    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:08:07.158027 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:07.157983    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" containerID="cri-o://34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008" gracePeriod=45
Oct 31 01:08:07.233532 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:08:07.233497    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:08:14.949030 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:14.948986    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:08:14.949409 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:14.949090    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:08:24.949681 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:24.949642    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:08:34.948826 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:34.948788    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:08:37.233050 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:08:37.233009    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:08:37.397209 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.397186    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:08:37.452429 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.452366    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\") pod \"a9a24379-f85d-422e-9973-b558504910fa\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") "
Oct 31 01:08:37.452429 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.452426    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\" (UniqueName: \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\") pod \"a9a24379-f85d-422e-9973-b558504910fa\" (UID: \"a9a24379-f85d-422e-9973-b558504910fa\") "
Oct 31 01:08:37.454622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.454571    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs" pod "a9a24379-f85d-422e-9973-b558504910fa" (UID: "a9a24379-f85d-422e-9973-b558504910fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:08:37.454735 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.454719    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc" pod "a9a24379-f85d-422e-9973-b558504910fa" (UID: "a9a24379-f85d-422e-9973-b558504910fa"). InnerVolumeSpecName "kube-api-access-jnfpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:08:37.553139 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.553101    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnfpc\" (UniqueName: \"kubernetes.io/projected/a9a24379-f85d-422e-9973-b558504910fa-kube-api-access-jnfpc\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:08:37.553139 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.553126    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a24379-f85d-422e-9973-b558504910fa-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:08:37.558786 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.558761    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:37.576513 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.576487    7559 generic.go:356] "Generic (PLEG): container finished" podID="a9a24379-f85d-422e-9973-b558504910fa" containerID="34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008" exitCode=0
Oct 31 01:08:37.576628 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.576531    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"
Oct 31 01:08:37.576628 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.576552    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" event={"ID":"a9a24379-f85d-422e-9973-b558504910fa","Type":"ContainerDied","Data":"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"}
Oct 31 01:08:37.576628 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.576590    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm" event={"ID":"a9a24379-f85d-422e-9973-b558504910fa","Type":"ContainerDied","Data":"7d05087fa208bf1ed9ad6424d9a895594d9c5a1e0dccaf7fab17fa7382eeeb74"}
Oct 31 01:08:37.576776 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.576627    7559 scope.go:122] "RemoveContainer" containerID="34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"
Oct 31 01:08:37.585350 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.585334    7559 scope.go:122] "RemoveContainer" containerID="34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"
Oct 31 01:08:37.585636 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:08:37.585619    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008\": container with ID starting with 34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008 not found: ID does not exist" containerID="34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"
Oct 31 01:08:37.585688 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.585644    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008"} err="failed to get container status \"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008\": rpc error: code = NotFound desc = could not find container \"34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008\": container with ID starting with 34eb2c590281a07406f19267695e967dca69f24c32a461e017b6ba92cbd4b008 not found: ID does not exist"
Oct 31 01:08:37.732274 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.732209    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:08:37.737750 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.737732    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schegltsm"]
Oct 31 01:08:37.758430 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.758406    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:37.778454 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:37.778427    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9a24379-f85d-422e-9973-b558504910fa" path="/var/lib/kubelet/pods/a9a24379-f85d-422e-9973-b558504910fa/volumes"
Oct 31 01:08:39.045061 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:39.045025    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:39.250165 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:39.250134    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:45.006282 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:45.006245    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:46.419487 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:46.419453    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:51.330583 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:51.330548    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:52.799473 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.799442    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:52.954017 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.953982    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:08:52.954356 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.954343    7559 cpu_manager.go:414] "containerMap: removing container" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main"
Oct 31 01:08:52.954414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.954357    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main"
Oct 31 01:08:52.954414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.954409    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9a24379-f85d-422e-9973-b558504910fa" containerName="main"
Oct 31 01:08:52.957232 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:52.957217    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.053697 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.053593    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"default-dockercfg-dzgtx\""
Oct 31 01:08:53.053697 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.053632    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"openshift-service-ca.crt\""
Oct 31 01:08:53.053697 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.053647    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"kube-root-ca.crt\""
Oct 31 01:08:53.053697 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.053679    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"custom-route-timeout-test-kserve-self-signed-certs\""
Oct 31 01:08:53.054013 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.054001    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"custom-route-timeout-test-epp-sa-dockercfg-qdzcj\""
Oct 31 01:08:53.055054 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.055036    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:08:53.081108 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.081083    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwpnv\" (UniqueName: \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.081226 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.081207    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.101893 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.101853    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:53.182581 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.182554    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.182751 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.182648    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwpnv\" (UniqueName: \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.185357 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.185332    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.247044 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.247014    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwpnv\" (UniqueName: \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.269727 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.269703    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:53.311371 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.311298    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:53.639713 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:53.639638    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:08:53.646185 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:08:53.646162    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbe201e_0478_42e7_b97d_b8ca14bff6af.slice/crio-7b165098c85519a5e68a9c4bd3871dcd735f6e7c58574125414e98f2065b48cb WatchSource:0}: Error finding container 7b165098c85519a5e68a9c4bd3871dcd735f6e7c58574125414e98f2065b48cb: Status 404 returned error can't find the container with id 7b165098c85519a5e68a9c4bd3871dcd735f6e7c58574125414e98f2065b48cb
Oct 31 01:08:54.137040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.137007    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:54.377889 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.377856    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:08:54.647757 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.647721    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" event={"ID":"cfbe201e-0478-42e7-b97d-b8ca14bff6af","Type":"ContainerStarted","Data":"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"}
Oct 31 01:08:54.647908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.647794    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" event={"ID":"cfbe201e-0478-42e7-b97d-b8ca14bff6af","Type":"ContainerStarted","Data":"7b165098c85519a5e68a9c4bd3871dcd735f6e7c58574125414e98f2065b48cb"}
Oct 31 01:08:54.647908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.647856    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:08:54.759535 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:54.759493    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podStartSLOduration=2.759479947 podStartE2EDuration="2.759479947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:08:54.758257774 +0000 UTC m=+2339.133152995" watchObservedRunningTime="2026-10-31 01:08:54.759479947 +0000 UTC m=+2339.134375167"
Oct 31 01:08:58.680624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:58.680400    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:08:58.690839 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:08:58.690781    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" containerID="cri-o://1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1" gracePeriod=30
Oct 31 01:09:02.438950 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:02.438889    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-k9d69 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 01:09:02.439624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:02.439548    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 01:09:04.470073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:04.469971    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:09:07.233771 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:09:07.233734    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:09:07.623095 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:07.623010    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:09:08.337749 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.337725    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:09:08.505762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505682    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505728    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505777    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505806    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505833    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505864    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505920    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505955    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.505999 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.505979    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\") pod \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\" (UID: \"4d261c5a-28d5-4b54-a5c0-ad732654b0d5\") "
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506133    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506147    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506347    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506338    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506378    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.506539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506476    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:09:08.506808 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.506593    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:09:08.508362 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.508338    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:09:08.508840 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.508788    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:09:08.508942 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.508900    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:09:08.512715 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.512691    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5" pod "4d261c5a-28d5-4b54-a5c0-ad732654b0d5" (UID: "4d261c5a-28d5-4b54-a5c0-ad732654b0d5"). InnerVolumeSpecName "kube-api-access-fqsg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:09:08.607507 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607480    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqsg5\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-kube-api-access-fqsg5\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607507 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607505    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607515    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607523    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607532    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607540    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.607672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.607548    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d261c5a-28d5-4b54-a5c0-ad732654b0d5-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:09:08.737474 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.737438    7559 generic.go:356] "Generic (PLEG): container finished" podID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerID="1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1" exitCode=0
Oct 31 01:09:08.737657 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.737488    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"
Oct 31 01:09:08.737657 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.737529    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" event={"ID":"4d261c5a-28d5-4b54-a5c0-ad732654b0d5","Type":"ContainerDied","Data":"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"}
Oct 31 01:09:08.737657 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.737584    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69" event={"ID":"4d261c5a-28d5-4b54-a5c0-ad732654b0d5","Type":"ContainerDied","Data":"bc3897898c52754c3547be9722b528bc6e34272a1b9e9443e7c2f487931e5512"}
Oct 31 01:09:08.737657 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.737631    7559 scope.go:122] "RemoveContainer" containerID="1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"
Oct 31 01:09:08.746591 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.746575    7559 scope.go:122] "RemoveContainer" containerID="1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"
Oct 31 01:09:08.746865 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:09:08.746848    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1\": container with ID starting with 1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1 not found: ID does not exist" containerID="1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"
Oct 31 01:09:08.746917 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.746874    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1"} err="failed to get container status \"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1\": rpc error: code = NotFound desc = could not find container \"1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1\": container with ID starting with 1a590b54fb4bbef2a5e8388dad026b1908201684a8e120491161e194c0d307d1 not found: ID does not exist"
Oct 31 01:09:08.895381 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.895319    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:09:08.901230 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:08.901211    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69"]
Oct 31 01:09:09.777551 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:09.777516    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" path="/var/lib/kubelet/pods/4d261c5a-28d5-4b54-a5c0-ad732654b0d5/volumes"
Oct 31 01:09:25.654444 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:25.654415    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:09:28.972930 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:28.972897    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:09:28.973389 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:28.973251    7559 cpu_manager.go:414] "containerMap: removing container" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy"
Oct 31 01:09:28.973389 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:28.973265    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy"
Oct 31 01:09:28.973389 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:28.973351    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d261c5a-28d5-4b54-a5c0-ad732654b0d5" containerName="istio-proxy"
Oct 31 01:09:28.977086 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:28.977063    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072535    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072566    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072755 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072593    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072791 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072748    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072825 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072794    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072861 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072852    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072893 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072867    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072936 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072920    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.072970 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.072950    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29dwl\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.173908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.173875    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.173924    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.173955    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.173983    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.173999    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174118    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174158    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29dwl\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174198    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174220    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174479 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174440    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174707 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174682    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174757    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174743    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.174882 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.174838    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.176654 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.176629    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.176970 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.176943    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.177267 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.177246    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:09:29.233880 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.233819    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.234022 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.233953    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29dwl\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\") pod \"openshift-ai-inference-openshift-default-568c495856-zmkpb\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.289510 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.289484    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:29.713512 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.713484    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:09:29.720362 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:09:29.720338    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96a2d05_69ef_47dd_aba7_737da4dbd5c9.slice/crio-a059b38bc71aadf4169271df0f46ad983b8eb428615c6636bad62dadf37d5cfe WatchSource:0}: Error finding container a059b38bc71aadf4169271df0f46ad983b8eb428615c6636bad62dadf37d5cfe: Status 404 returned error can't find the container with id a059b38bc71aadf4169271df0f46ad983b8eb428615c6636bad62dadf37d5cfe
Oct 31 01:09:29.722291 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.722258    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:09:29.722349 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.722330    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:09:29.722385 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.722359    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:09:29.830878 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.830839    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" event={"ID":"a96a2d05-69ef-47dd-aba7-737da4dbd5c9","Type":"ContainerStarted","Data":"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"}
Oct 31 01:09:29.831061 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.830904    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" event={"ID":"a96a2d05-69ef-47dd-aba7-737da4dbd5c9","Type":"ContainerStarted","Data":"a059b38bc71aadf4169271df0f46ad983b8eb428615c6636bad62dadf37d5cfe"}
Oct 31 01:09:29.946590 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:29.946537    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podStartSLOduration=1.9465229179999999 podStartE2EDuration="1.946522918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:29.944888358 +0000 UTC m=+2374.319783594" watchObservedRunningTime="2026-10-31 01:09:29.946522918 +0000 UTC m=+2374.321418135"
Oct 31 01:09:30.289930 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:30.289903    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:30.291166 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:30.291143    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:30.291285 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:30.291192    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:31.290101 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:31.290068    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:31.290497 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:31.290117    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:32.290136 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:32.290102    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:32.290525 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:32.290156    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:33.290136 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:33.290100    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:33.290527 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:33.290151    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:34.289905 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:34.289872    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:34.290080 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:34.289922    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:35.290250 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:35.290214    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 31 01:09:35.290636 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:35.290278    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 31 01:09:36.294151 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:36.294113    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:36.294661 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:36.294496    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:36.295237 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:36.295218    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:09:37.233861 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:09:37.233828    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:09:51.998711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:09:51.998680    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:02.419143 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:02.419111    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:07.233127 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:10:07.233089    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:10:16.529122 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:16.529088    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:16.727434 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:16.727397    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:37.234206 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:10:37.234168    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:10:45.070880 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:45.070843    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:45.289274 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:45.289240    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:51.639519 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:51.639484    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:10:51.768488 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:51.768455    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:51.960902 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:51.960869    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:52.305404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:52.305322    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:10:55.654083 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:10:55.654043    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:11:03.891343 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:03.891314    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:04.113776 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:04.113741    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:05.654363 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:05.654326    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:11:06.659969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:06.659930    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" containerID="cri-o://bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191" gracePeriod=45
Oct 31 01:11:07.234858 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:11:07.234816    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:11:10.816258 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:10.816217    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:15.654869 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:15.654831    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:11:15.655243 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:15.654958    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:11:17.022898 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:17.022870    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:17.234741 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:17.234711    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:18.054589 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:18.054554    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:18.563206 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:18.563177    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:25.654863 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:25.654816    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:11:27.010308 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:27.010267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:35.654715 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:35.654668    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:11:36.901400 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:36.901377    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:11:37.059411 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.059343    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\") pod \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") "
Oct 31 01:11:37.059572 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.059417    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\" (UniqueName: \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\") pod \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\" (UID: \"cfbe201e-0478-42e7-b97d-b8ca14bff6af\") "
Oct 31 01:11:37.061590 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.061564    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs" pod "cfbe201e-0478-42e7-b97d-b8ca14bff6af" (UID: "cfbe201e-0478-42e7-b97d-b8ca14bff6af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:11:37.061712 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.061660    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv" pod "cfbe201e-0478-42e7-b97d-b8ca14bff6af" (UID: "cfbe201e-0478-42e7-b97d-b8ca14bff6af"). InnerVolumeSpecName "kube-api-access-xwpnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:11:37.160310 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.160284    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwpnv\" (UniqueName: \"kubernetes.io/projected/cfbe201e-0478-42e7-b97d-b8ca14bff6af-kube-api-access-xwpnv\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:37.160310 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.160309    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbe201e-0478-42e7-b97d-b8ca14bff6af-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:37.234148 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:11:37.234115    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:11:37.373297 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.373216    7559 generic.go:356] "Generic (PLEG): container finished" podID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerID="bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191" exitCode=0
Oct 31 01:11:37.373297 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.373264    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"
Oct 31 01:11:37.373465 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.373301    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" event={"ID":"cfbe201e-0478-42e7-b97d-b8ca14bff6af","Type":"ContainerDied","Data":"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"}
Oct 31 01:11:37.373465 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.373357    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777" event={"ID":"cfbe201e-0478-42e7-b97d-b8ca14bff6af","Type":"ContainerDied","Data":"7b165098c85519a5e68a9c4bd3871dcd735f6e7c58574125414e98f2065b48cb"}
Oct 31 01:11:37.373465 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.373380    7559 scope.go:122] "RemoveContainer" containerID="bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"
Oct 31 01:11:37.382335 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.382316    7559 scope.go:122] "RemoveContainer" containerID="bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"
Oct 31 01:11:37.382618 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:11:37.382580    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191\": container with ID starting with bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191 not found: ID does not exist" containerID="bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"
Oct 31 01:11:37.382680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.382620    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191"} err="failed to get container status \"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191\": rpc error: code = NotFound desc = could not find container \"bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191\": container with ID starting with bb1c9569de8b178bde4cd946814ca58d716358310ffacdf4c58d12b227d38191 not found: ID does not exist"
Oct 31 01:11:37.533062 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.533030    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:11:37.578923 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.578895    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d54hh777"]
Oct 31 01:11:37.778123 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:37.778087    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" path="/var/lib/kubelet/pods/cfbe201e-0478-42e7-b97d-b8ca14bff6af/volumes"
Oct 31 01:11:41.145570 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:41.145536    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:41.337252 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:41.337220    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:41.821440 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:41.821405    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:42.016927 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:42.016841    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:42.796494 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:42.796460    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:45.998691 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:45.998662    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:47.994559 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:47.994523    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:48.460375 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.460337    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:11:48.460725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.460713    7559 cpu_manager.go:414] "containerMap: removing container" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main"
Oct 31 01:11:48.460775 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.460727    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main"
Oct 31 01:11:48.460818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.460809    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="cfbe201e-0478-42e7-b97d-b8ca14bff6af" containerName="main"
Oct 31 01:11:48.465350 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.465328    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.521548 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.521519    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"kube-root-ca.crt\""
Oct 31 01:11:48.523750 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.523730    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"openshift-service-ca.crt\""
Oct 31 01:11:48.557966 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.557932    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9pk\" (UniqueName: \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.558098 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.557977    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.569027 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.569002    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:11:48.570196 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.570172    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"default-dockercfg-qcrbp\""
Oct 31 01:11:48.570196 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.570172    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-epp-sa-dockercfg-cl6s5\""
Oct 31 01:11:48.570382 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.570279    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-kserve-self-signed-certs\""
Oct 31 01:11:48.611774 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.611742    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:48.659359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.659329    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9pk\" (UniqueName: \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.659533 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.659373    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.661911 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.661891    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.719273 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.719213    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9pk\" (UniqueName: \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.777986 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.777953    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:48.845129 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:48.845065    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:49.138441 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.138207    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:49.149976 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.149947    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:11:49.158447 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:11:49.158421    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f68feca_6fa7_4a0f_b605_1a752aee8017.slice/crio-99192dcf9cab21074d11d973ca056a9173567698e0113bf580b0075eff3ba257 WatchSource:0}: Error finding container 99192dcf9cab21074d11d973ca056a9173567698e0113bf580b0075eff3ba257: Status 404 returned error can't find the container with id 99192dcf9cab21074d11d973ca056a9173567698e0113bf580b0075eff3ba257
Oct 31 01:11:49.426636 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.426579    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" event={"ID":"2f68feca-6fa7-4a0f-b605-1a752aee8017","Type":"ContainerStarted","Data":"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"}
Oct 31 01:11:49.426828 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.426660    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" event={"ID":"2f68feca-6fa7-4a0f-b605-1a752aee8017","Type":"ContainerStarted","Data":"99192dcf9cab21074d11d973ca056a9173567698e0113bf580b0075eff3ba257"}
Oct 31 01:11:49.426828 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.426701    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:11:49.538415 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:49.538339    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podStartSLOduration=1.538324585 podStartE2EDuration="1.538324585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:49.538037203 +0000 UTC m=+2513.912932443" watchObservedRunningTime="2026-10-31 01:11:49.538324585 +0000 UTC m=+2513.913219805"
Oct 31 01:11:52.653625 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:52.653571    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:55.344117 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:55.344084    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:11:55.617298 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:11:55.617206    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:12:07.233903 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:12:07.233821    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:12:20.433117 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:12:20.433084    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:12:37.233896 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:12:37.233861    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:12:52.989621 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:12:52.989564    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:07.233354 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:13:07.233309    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:13:12.013549 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:12.013511    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:12.259260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:12.259227    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:12.490645 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:12.490618    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:24.566780 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.566745    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:24.896226 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.896148    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:13:24.899647 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.899625    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:24.946101 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.946065    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:24.946253 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.946119    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8b9p\" (UniqueName: \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:24.995874 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.995843    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-skk9x\""
Oct 31 01:13:24.995874 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.995846    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\""
Oct 31 01:13:24.996043 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.995890    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\""
Oct 31 01:13:24.996043 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.995908    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-jf94k\""
Oct 31 01:13:24.996270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.996255    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\""
Oct 31 01:13:24.997474 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:24.997456    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:13:25.047138 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.047105    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.047307 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.047140    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8b9p\" (UniqueName: \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.048063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.048027    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:25.050513 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.050486    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.106821 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.106798    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8b9p\" (UniqueName: \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.212050 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.212028    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.581443 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.581362    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:13:25.588329 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:13:25.588294    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4bd823_fe06_417e_bd6e_fa000c912040.slice/crio-acecd7355038ec886525b5277f48704a6aaa8ceb7662b820d22101353bbce0b7 WatchSource:0}: Error finding container acecd7355038ec886525b5277f48704a6aaa8ceb7662b820d22101353bbce0b7: Status 404 returned error can't find the container with id acecd7355038ec886525b5277f48704a6aaa8ceb7662b820d22101353bbce0b7
Oct 31 01:13:25.841584 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.841503    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" event={"ID":"6b4bd823-fe06-417e-bd6e-fa000c912040","Type":"ContainerStarted","Data":"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"}
Oct 31 01:13:25.841584 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.841572    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" event={"ID":"6b4bd823-fe06-417e-bd6e-fa000c912040","Type":"ContainerStarted","Data":"acecd7355038ec886525b5277f48704a6aaa8ceb7662b820d22101353bbce0b7"}
Oct 31 01:13:25.841771 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.841651    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:13:25.952912 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:25.952848    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podStartSLOduration=1.952836915 podStartE2EDuration="1.952836915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:25.952474126 +0000 UTC m=+2610.327369346" watchObservedRunningTime="2026-10-31 01:13:25.952836915 +0000 UTC m=+2610.327732135"
Oct 31 01:13:29.736910 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:29.736829    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:37.234268 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:13:37.234232    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:13:39.861836 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:39.861803    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:46.290142 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:46.290108    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:13:46.385650 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:46.385584    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:46.645155 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:46.645074    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:50.433284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:50.433241    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:13:53.343382 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:53.343342    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:13:56.847480 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:13:56.847451    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:14:00.432576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:00.432530    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:14:01.309681 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:01.309627    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" containerID="cri-o://07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6" gracePeriod=45
Oct 31 01:14:04.469177 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:04.469135    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:07.234353 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:14:07.234309    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:14:10.432854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:10.432815    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:14:10.433258 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:10.432929    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:14:20.432261 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:20.432224    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:14:30.432912 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:30.432871    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:14:31.563368 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.563341    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:14:31.679123 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.679092    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\") pod \"2f68feca-6fa7-4a0f-b605-1a752aee8017\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") "
Oct 31 01:14:31.679301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.679194    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\" (UniqueName: \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\") pod \"2f68feca-6fa7-4a0f-b605-1a752aee8017\" (UID: \"2f68feca-6fa7-4a0f-b605-1a752aee8017\") "
Oct 31 01:14:31.681725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.681695    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs" pod "2f68feca-6fa7-4a0f-b605-1a752aee8017" (UID: "2f68feca-6fa7-4a0f-b605-1a752aee8017"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:14:31.681861 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.681744    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk" pod "2f68feca-6fa7-4a0f-b605-1a752aee8017" (UID: "2f68feca-6fa7-4a0f-b605-1a752aee8017"). InnerVolumeSpecName "kube-api-access-gl9pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:14:31.784204 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.784176    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f68feca-6fa7-4a0f-b605-1a752aee8017-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:31.784204 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:31.784203    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl9pk\" (UniqueName: \"kubernetes.io/projected/2f68feca-6fa7-4a0f-b605-1a752aee8017-kube-api-access-gl9pk\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:32.127107 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.127023    7559 generic.go:356] "Generic (PLEG): container finished" podID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerID="07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6" exitCode=0
Oct 31 01:14:32.127107 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.127088    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"
Oct 31 01:14:32.127270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.127109    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" event={"ID":"2f68feca-6fa7-4a0f-b605-1a752aee8017","Type":"ContainerDied","Data":"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"}
Oct 31 01:14:32.127270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.127164    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz" event={"ID":"2f68feca-6fa7-4a0f-b605-1a752aee8017","Type":"ContainerDied","Data":"99192dcf9cab21074d11d973ca056a9173567698e0113bf580b0075eff3ba257"}
Oct 31 01:14:32.127270 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.127186    7559 scope.go:122] "RemoveContainer" containerID="07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"
Oct 31 01:14:32.135365 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.135344    7559 scope.go:122] "RemoveContainer" containerID="07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"
Oct 31 01:14:32.135650 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:14:32.135631    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6\": container with ID starting with 07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6 not found: ID does not exist" containerID="07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"
Oct 31 01:14:32.135706 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.135658    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6"} err="failed to get container status \"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6\": rpc error: code = NotFound desc = could not find container \"07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6\": container with ID starting with 07f2ec8851b37b3da9bae619764513ed775e3510fc875179a3029d911acb92d6 not found: ID does not exist"
Oct 31 01:14:32.284278 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.284243    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:14:32.317078 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:32.317051    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-6dmfz"]
Oct 31 01:14:33.778756 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:33.778724    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" path="/var/lib/kubelet/pods/2f68feca-6fa7-4a0f-b605-1a752aee8017/volumes"
Oct 31 01:14:35.876907 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:35.876857    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:36.080813 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:36.080780    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:37.234381 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:14:37.234349    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:14:40.848611 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:40.848569    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:42.068778 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:42.068738    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:42.614332 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:42.614302    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:46.442410 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:46.442327    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:14:46.442809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:46.442521    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" containerID="cri-o://b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6" gracePeriod=30
Oct 31 01:14:46.488162 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:46.488129    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:14:46.488705 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:46.488387    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" containerID="cri-o://57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20" gracePeriod=30
Oct 31 01:14:48.454767 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:48.454735    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-t4bb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 01:14:48.455207 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:48.454792    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 01:14:50.918380 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:50.918339    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:51.296881 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.296789    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-zmkpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 01:14:51.296881 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.296857    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 01:14:51.722833 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.722810    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:14:51.750901 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.750879    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:14:51.854238 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854174    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854238 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854217    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854242    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854266    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854291    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854340    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854375    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854417    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854450    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854475    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854516    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854568    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854616    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854647    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854678    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854711    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\") pod \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\" (UID: \"a96a2d05-69ef-47dd-aba7-737da4dbd5c9\") "
Oct 31 01:14:51.854764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854744    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854769    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\") pod \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\" (UID: \"56c91d71-b5de-4b03-b7dd-af6c7dfd9537\") "
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854823    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854746    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.854749    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.855005    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.855023    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.855359 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.855220    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.855740 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.855407    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.856455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856345    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.856455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856372    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.856455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856388    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.856455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856402    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.856455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856415    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.857373 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.857337    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.857571 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.857551    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.857949 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.857930    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.858095 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.856430    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.858173 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.858085    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.858173 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.858117    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.859272 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.859240    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:14:51.859361 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.859314    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:14:51.859655 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.859626    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "kube-api-access-fxnpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:14:51.859779 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.859758    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:14:51.864623 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.859918    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "kube-api-access-29dwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:14:51.865940 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.864911    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token" pod "56c91d71-b5de-4b03-b7dd-af6c7dfd9537" (UID: "56c91d71-b5de-4b03-b7dd-af6c7dfd9537"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:14:51.867000 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.866978    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token" pod "a96a2d05-69ef-47dd-aba7-737da4dbd5c9" (UID: "a96a2d05-69ef-47dd-aba7-737da4dbd5c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:14:51.958587 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958565    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958587 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958586    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958620    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958631    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958640    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958648    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958656    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29dwl\" (UniqueName: \"kubernetes.io/projected/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-kube-api-access-29dwl\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958665    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxnpp\" (UniqueName: \"kubernetes.io/projected/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-kube-api-access-fxnpp\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958673    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958681    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a96a2d05-69ef-47dd-aba7-737da4dbd5c9-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:51.958943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:51.958689    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56c91d71-b5de-4b03-b7dd-af6c7dfd9537-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:14:52.214936 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.214899    7559 generic.go:356] "Generic (PLEG): container finished" podID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerID="57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20" exitCode=0
Oct 31 01:14:52.215077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.214982    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"
Oct 31 01:14:52.215077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.214982    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" event={"ID":"a96a2d05-69ef-47dd-aba7-737da4dbd5c9","Type":"ContainerDied","Data":"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"}
Oct 31 01:14:52.215180 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.215132    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb" event={"ID":"a96a2d05-69ef-47dd-aba7-737da4dbd5c9","Type":"ContainerDied","Data":"a059b38bc71aadf4169271df0f46ad983b8eb428615c6636bad62dadf37d5cfe"}
Oct 31 01:14:52.215180 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.215155    7559 scope.go:122] "RemoveContainer" containerID="57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"
Oct 31 01:14:52.216331 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.216289    7559 generic.go:356] "Generic (PLEG): container finished" podID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerID="b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6" exitCode=0
Oct 31 01:14:52.216436 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.216323    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" event={"ID":"56c91d71-b5de-4b03-b7dd-af6c7dfd9537","Type":"ContainerDied","Data":"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"}
Oct 31 01:14:52.216436 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.216354    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"
Oct 31 01:14:52.216436 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.216388    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8" event={"ID":"56c91d71-b5de-4b03-b7dd-af6c7dfd9537","Type":"ContainerDied","Data":"947e59e120ebae1283ffc6248a2f44184865cd1ee76ee4fb8cb2556e9405f0c0"}
Oct 31 01:14:52.225029 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.225013    7559 scope.go:122] "RemoveContainer" containerID="57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"
Oct 31 01:14:52.225315 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:14:52.225288    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20\": container with ID starting with 57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20 not found: ID does not exist" containerID="57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"
Oct 31 01:14:52.225408 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.225326    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20"} err="failed to get container status \"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20\": rpc error: code = NotFound desc = could not find container \"57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20\": container with ID starting with 57f36b5f6bf72f83e6e5ebd16ea829bf631b4d4610d66ed6875f99ebe7de6d20 not found: ID does not exist"
Oct 31 01:14:52.225408 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.225359    7559 scope.go:122] "RemoveContainer" containerID="b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"
Oct 31 01:14:52.232984 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.232964    7559 scope.go:122] "RemoveContainer" containerID="b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"
Oct 31 01:14:52.233232 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:14:52.233212    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6\": container with ID starting with b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6 not found: ID does not exist" containerID="b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"
Oct 31 01:14:52.233289 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.233242    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6"} err="failed to get container status \"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6\": rpc error: code = NotFound desc = could not find container \"b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6\": container with ID starting with b9293f8853b17a95f6176758e093e0c8dd1194695fd4eb3e155a16fa3127a7a6 not found: ID does not exist"
Oct 31 01:14:52.372680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.372652    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:14:52.378231 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.378209    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8"]
Oct 31 01:14:52.483939 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.483875    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:14:52.490543 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:52.490522    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb"]
Oct 31 01:14:53.677252 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:53.677222    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:14:53.777751 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:53.777725    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" path="/var/lib/kubelet/pods/56c91d71-b5de-4b03-b7dd-af6c7dfd9537/volumes"
Oct 31 01:14:53.778127 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:14:53.778115    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" path="/var/lib/kubelet/pods/a96a2d05-69ef-47dd-aba7-737da4dbd5c9/volumes"
Oct 31 01:15:03.108750 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:03.108700    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:04.315459 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:04.315394    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:07.234331 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:15:07.234274    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:15:10.565980 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:10.565942    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:19.927817 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:19.927778    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:23.028263 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:23.028231    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:15:23.114736 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:23.114694    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:23.311448 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:23.311368    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:26.848247 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:26.848210    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:15:26.998570 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:26.998531    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:27.194031 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:27.193996    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:36.847760 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:36.847719    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:15:37.233697 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:15:37.233654    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:15:38.047994 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:38.047955    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" containerID="cri-o://74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb" gracePeriod=45
Oct 31 01:15:46.847774 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:46.847733    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:15:46.848191 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:46.847854    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:15:54.070116 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:54.070082    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:15:56.848220 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:15:56.848181    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:16:06.847511 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:06.847475    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:16:07.233626 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:16:07.233571    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:16:08.293401 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.293375    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:16:08.464425 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.464388    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\") pod \"6b4bd823-fe06-417e-bd6e-fa000c912040\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") "
Oct 31 01:16:08.464591 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.464477    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\" (UniqueName: \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\") pod \"6b4bd823-fe06-417e-bd6e-fa000c912040\" (UID: \"6b4bd823-fe06-417e-bd6e-fa000c912040\") "
Oct 31 01:16:08.466777 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.466748    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs" pod "6b4bd823-fe06-417e-bd6e-fa000c912040" (UID: "6b4bd823-fe06-417e-bd6e-fa000c912040"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:16:08.466886 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.466827    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p" pod "6b4bd823-fe06-417e-bd6e-fa000c912040" (UID: "6b4bd823-fe06-417e-bd6e-fa000c912040"). InnerVolumeSpecName "kube-api-access-g8b9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:16:08.527130 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.527103    7559 generic.go:356] "Generic (PLEG): container finished" podID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerID="74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb" exitCode=0
Oct 31 01:16:08.527259 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.527150    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"
Oct 31 01:16:08.527259 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.527193    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" event={"ID":"6b4bd823-fe06-417e-bd6e-fa000c912040","Type":"ContainerDied","Data":"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"}
Oct 31 01:16:08.527259 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.527253    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x" event={"ID":"6b4bd823-fe06-417e-bd6e-fa000c912040","Type":"ContainerDied","Data":"acecd7355038ec886525b5277f48704a6aaa8ceb7662b820d22101353bbce0b7"}
Oct 31 01:16:08.527423 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.527282    7559 scope.go:122] "RemoveContainer" containerID="74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"
Oct 31 01:16:08.535747 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.535732    7559 scope.go:122] "RemoveContainer" containerID="74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"
Oct 31 01:16:08.536013 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:16:08.535993    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb\": container with ID starting with 74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb not found: ID does not exist" containerID="74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"
Oct 31 01:16:08.536074 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.536025    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb"} err="failed to get container status \"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb\": rpc error: code = NotFound desc = could not find container \"74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb\": container with ID starting with 74e302e8b088a38a870221270b043c27d98420ce7ce541a2e9c433a86a71f9eb not found: ID does not exist"
Oct 31 01:16:08.565539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.565515    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4bd823-fe06-417e-bd6e-fa000c912040-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:16:08.565539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.565539    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8b9p\" (UniqueName: \"kubernetes.io/projected/6b4bd823-fe06-417e-bd6e-fa000c912040-kube-api-access-g8b9p\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:16:08.684354 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.684328    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:16:08.690556 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:08.690532    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-2c28x"]
Oct 31 01:16:09.778456 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:09.778427    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" path="/var/lib/kubelet/pods/6b4bd823-fe06-417e-bd6e-fa000c912040/volumes"
Oct 31 01:16:10.020307 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:10.020275    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:10.236952 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:10.236923    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:17.198213 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:17.198178    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:20.230030 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:20.230002    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:23.988241 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:23.988212    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:24.185847 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:24.185814    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:28.714567 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:28.714529    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:28.910241 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:28.910206    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:37.234430 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:16:37.234392    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:16:54.355718 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:54.355684    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:55.996478 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:55.996431    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:16:56.221899 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:16:56.221865    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:07.233363 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:17:07.233323    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:17:37.234007 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:17:37.233972    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:17:45.560991 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:45.560958    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:45.763816 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:45.763780    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:51.346650 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.346615    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:51.711869 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.711838    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:17:51.712183 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712169    7559 cpu_manager.go:414] "containerMap: removing container" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712187    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712209    7559 cpu_manager.go:414] "containerMap: removing container" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712214    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712226    7559 cpu_manager.go:414] "containerMap: removing container" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712230    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712250    7559 cpu_manager.go:414] "containerMap: removing container" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy"
Oct 31 01:17:51.712275 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712257    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy"
Oct 31 01:17:51.712489 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712309    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="a96a2d05-69ef-47dd-aba7-737da4dbd5c9" containerName="istio-proxy"
Oct 31 01:17:51.712489 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712316    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="56c91d71-b5de-4b03-b7dd-af6c7dfd9537" containerName="istio-proxy"
Oct 31 01:17:51.712489 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712324    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f68feca-6fa7-4a0f-b605-1a752aee8017" containerName="main"
Oct 31 01:17:51.712489 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.712335    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b4bd823-fe06-417e-bd6e-fa000c912040" containerName="main"
Oct 31 01:17:51.715180 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.715162    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.744477 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.744452    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.744569 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.744482    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxzf\" (UniqueName: \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.811625 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.811574    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"default-dockercfg-wxft4\""
Oct 31 01:17:51.811793 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.811625    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-hq4c2\""
Oct 31 01:17:51.811871 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.811843    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"kube-root-ca.crt\""
Oct 31 01:17:51.811922 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.811869    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"openshift-service-ca.crt\""
Oct 31 01:17:51.812014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.811986    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Oct 31 01:17:51.812786 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.812768    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:17:51.845168 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.845142    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.845168 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.845170    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxzf\" (UniqueName: \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.847681 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.847665    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:51.887996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.887969    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:51.905087 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:51.905067    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxzf\" (UniqueName: \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:52.027567 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:52.027497    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:52.391717 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:52.391643    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:17:52.394945 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:17:52.394905    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b8b9d6_d3f1_4881_8cac_339cbbaf5111.slice/crio-19b906d366bd54120a99f1c89ff52c17d80e24ffb4b30183a17f3ef330151d3b WatchSource:0}: Error finding container 19b906d366bd54120a99f1c89ff52c17d80e24ffb4b30183a17f3ef330151d3b: Status 404 returned error can't find the container with id 19b906d366bd54120a99f1c89ff52c17d80e24ffb4b30183a17f3ef330151d3b
Oct 31 01:17:52.952867 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:52.952828    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" event={"ID":"45b8b9d6-d3f1-4881-8cac-339cbbaf5111","Type":"ContainerStarted","Data":"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"}
Oct 31 01:17:52.953040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:52.952876    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" event={"ID":"45b8b9d6-d3f1-4881-8cac-339cbbaf5111","Type":"ContainerStarted","Data":"19b906d366bd54120a99f1c89ff52c17d80e24ffb4b30183a17f3ef330151d3b"}
Oct 31 01:17:52.953040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:52.952919    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:17:53.065544 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:53.065495    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podStartSLOduration=2.065481563 podStartE2EDuration="2.065481563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:17:53.064707379 +0000 UTC m=+2877.439602600" watchObservedRunningTime="2026-10-31 01:17:53.065481563 +0000 UTC m=+2877.440376784"
Oct 31 01:17:53.681119 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:53.681089    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:54.693089 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:54.693055    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:59.755648 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:59.755587    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:17:59.951580 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:17:59.951551    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:02.240186 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:02.240147    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:07.233525 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:18:07.233450    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:18:13.595197 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:13.595161    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:21.376266 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:21.376219    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:23.958436 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:23.958409    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:18:33.865062 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:33.865028    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:34.070957 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:34.070928    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:37.233548 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:18:37.233516    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:18:40.312413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:40.312380    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:40.506104 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:40.506067    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:47.372129 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:47.372094    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:18:55.036322 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:18:55.036286    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:19:07.233864 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:19:07.233826    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:19:37.234393 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:19:37.234354    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:19:55.315968 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:19:55.315922    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:19:55.321970 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:19:55.321945    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:19:55.553937 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:19:55.553903    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:19:56.603539 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:19:56.603500    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:19:56.814703 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:19:56.814669    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:03.958028 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:03.957983    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:20:07.233238 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:20:07.233202    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:20:10.341217 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:10.341175    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main" containerID="cri-o://eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715" gracePeriod=45
Oct 31 01:20:13.958439 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:13.958407    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:20:23.958538 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:23.958506    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:20:23.958963 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:23.958634    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:20:33.958704 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:33.958662    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:20:37.234403 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:20:37.234365    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:20:39.044326 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:39.044295    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:40.585403 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.585380    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:20:40.637757 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.637689    7559 generic.go:356] "Generic (PLEG): container finished" podID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerID="eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715" exitCode=0
Oct 31 01:20:40.637757 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.637732    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"
Oct 31 01:20:40.637901 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.637769    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" event={"ID":"45b8b9d6-d3f1-4881-8cac-339cbbaf5111","Type":"ContainerDied","Data":"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"}
Oct 31 01:20:40.637901 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.637820    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr" event={"ID":"45b8b9d6-d3f1-4881-8cac-339cbbaf5111","Type":"ContainerDied","Data":"19b906d366bd54120a99f1c89ff52c17d80e24ffb4b30183a17f3ef330151d3b"}
Oct 31 01:20:40.637901 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.637843    7559 scope.go:122] "RemoveContainer" containerID="eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"
Oct 31 01:20:40.645379 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.645353    7559 scope.go:122] "RemoveContainer" containerID="eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"
Oct 31 01:20:40.645676 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:20:40.645653    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715\": container with ID starting with eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715 not found: ID does not exist" containerID="eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"
Oct 31 01:20:40.645748 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.645695    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715"} err="failed to get container status \"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715\": rpc error: code = NotFound desc = could not find container \"eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715\": container with ID starting with eddc613cf2892efbb0282df75fae0455c125f764460ee1564e2cb705a9ca6715 not found: ID does not exist"
Oct 31 01:20:40.753940 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.753915    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\") pod \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") "
Oct 31 01:20:40.754064 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.753966    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\" (UniqueName: \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\") pod \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\" (UID: \"45b8b9d6-d3f1-4881-8cac-339cbbaf5111\") "
Oct 31 01:20:40.756134 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.756106    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf" pod "45b8b9d6-d3f1-4881-8cac-339cbbaf5111" (UID: "45b8b9d6-d3f1-4881-8cac-339cbbaf5111"). InnerVolumeSpecName "kube-api-access-nhxzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:20:40.756228 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.756127    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs" pod "45b8b9d6-d3f1-4881-8cac-339cbbaf5111" (UID: "45b8b9d6-d3f1-4881-8cac-339cbbaf5111"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:20:40.855394 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.855369    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:20:40.855394 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:40.855394    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhxzf\" (UniqueName: \"kubernetes.io/projected/45b8b9d6-d3f1-4881-8cac-339cbbaf5111-kube-api-access-nhxzf\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:20:41.051699 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:41.051674    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:20:41.057557 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:41.057536    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95mfjzr"]
Oct 31 01:20:41.777791 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:41.777758    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" path="/var/lib/kubelet/pods/45b8b9d6-d3f1-4881-8cac-339cbbaf5111/volumes"
Oct 31 01:20:44.901526 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:44.901489    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:45.102950 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:45.102916    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:45.638959 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:45.638929    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:45.836334 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:45.836256    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:49.321394 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:49.321360    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:52.341969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:52.341933    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:55.753793 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:55.753759    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:56.223472 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.223436    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:56.513628 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.513547    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:20:56.513943 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.513928    7559 cpu_manager.go:414] "containerMap: removing container" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main"
Oct 31 01:20:56.513986 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.513946    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main"
Oct 31 01:20:56.514024 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.514002    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="45b8b9d6-d3f1-4881-8cac-339cbbaf5111" containerName="main"
Oct 31 01:20:56.518250 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.518233    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.614457 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.614424    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-epp-sa-dockercfg-4hbgs\""
Oct 31 01:20:56.614644 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.614462    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Oct 31 01:20:56.614644 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.614474    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"kube-root-ca.crt\""
Oct 31 01:20:56.614644 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.614488    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"default-dockercfg-7hqmk\""
Oct 31 01:20:56.614644 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.614474    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-service-ca.crt\""
Oct 31 01:20:56.615338 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.615320    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:20:56.666874 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.666843    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:56.676238 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.676212    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.676383 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.676285    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlvs\" (UniqueName: \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.776991 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.776921    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.777322 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.776991    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlvs\" (UniqueName: \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.779481 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.779461    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.836566 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.836534    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlvs\" (UniqueName: \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:56.862677 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:56.862651    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:57.130555 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.130482    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:57.495557 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.495529    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:20:57.499053 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:20:57.499018    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60135ca1_a79f_4166_9f51_448e31575280.slice/crio-b7e05b169c84badfbd6ac8f88ea9d0023085a1a2c7a561cd2d6da439f00ef9d3 WatchSource:0}: Error finding container b7e05b169c84badfbd6ac8f88ea9d0023085a1a2c7a561cd2d6da439f00ef9d3: Status 404 returned error can't find the container with id b7e05b169c84badfbd6ac8f88ea9d0023085a1a2c7a561cd2d6da439f00ef9d3
Oct 31 01:20:57.711760 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.711729    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" event={"ID":"60135ca1-a79f-4166-9f51-448e31575280","Type":"ContainerStarted","Data":"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"}
Oct 31 01:20:57.711929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.711789    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" event={"ID":"60135ca1-a79f-4166-9f51-448e31575280","Type":"ContainerStarted","Data":"b7e05b169c84badfbd6ac8f88ea9d0023085a1a2c7a561cd2d6da439f00ef9d3"}
Oct 31 01:20:57.711929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.711818    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:20:57.823322 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:57.823233    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podStartSLOduration=1.8232170989999998 podStartE2EDuration="1.823217099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:20:57.822527599 +0000 UTC m=+3062.197422821" watchObservedRunningTime="2026-10-31 01:20:57.823217099 +0000 UTC m=+3062.198112321"
Oct 31 01:20:58.987132 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:58.987102    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:59.185093 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:59.185066    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:59.381093 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:59.381005    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:59.623640 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:59.623587    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:20:59.843774 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:20:59.843737    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:00.041276 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:00.041246    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:02.515085 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:02.515045    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:02.740380 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:02.740345    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:03.039708 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:03.039657    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:04.472588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:04.472512    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 01:21:04.472969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:04.472744    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy" containerID="cri-o://f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399" gracePeriod=30
Oct 31 01:21:06.011297 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:06.011257    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:06.208770 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:06.208738    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:07.234260 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:21:07.234224    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:21:09.710680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.710653    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 01:21:09.762372 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.762304    7559 generic.go:356] "Generic (PLEG): container finished" podID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerID="f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399" exitCode=0
Oct 31 01:21:09.762372 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.762348    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"
Oct 31 01:21:09.762372 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.762366    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerDied","Data":"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"}
Oct 31 01:21:09.762646 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.762420    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg" event={"ID":"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245","Type":"ContainerDied","Data":"f84aca7ab6f15c741de0722477dfd8b25034638cc137796cce79e893547565d6"}
Oct 31 01:21:09.762646 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.762450    7559 scope.go:122] "RemoveContainer" containerID="f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"
Oct 31 01:21:09.770404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.770389    7559 scope.go:122] "RemoveContainer" containerID="43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"
Oct 31 01:21:09.778819 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.778804    7559 scope.go:122] "RemoveContainer" containerID="f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"
Oct 31 01:21:09.779068 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:21:09.779052    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399\": container with ID starting with f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399 not found: ID does not exist" containerID="f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"
Oct 31 01:21:09.779118 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.779078    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399"} err="failed to get container status \"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399\": rpc error: code = NotFound desc = could not find container \"f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399\": container with ID starting with f09749b6a8b8228842ac6cf8e98615f0e706f8ab45055548650aaea6c9d83399 not found: ID does not exist"
Oct 31 01:21:09.779118 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.779092    7559 scope.go:122] "RemoveContainer" containerID="43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"
Oct 31 01:21:09.779291 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:21:09.779275    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5\": container with ID starting with 43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5 not found: ID does not exist" containerID="43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"
Oct 31 01:21:09.779339 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.779296    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5"} err="failed to get container status \"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5\": rpc error: code = NotFound desc = could not find container \"43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5\": container with ID starting with 43c3eb06476e34aeb50c2f1c13bcfa57b47d8e993a1ba2ca9e7dacd27a504ba5 not found: ID does not exist"
Oct 31 01:21:09.780663 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780571    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780766 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780680    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780766 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780710    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780766 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780745    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780796    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780842    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.780926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780879    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.781077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780925    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.781077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780918    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:21:09.781077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780971    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\") pod \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\" (UID: \"e01ebc0c-ea87-4ffe-81a4-95f6a6d06245\") "
Oct 31 01:21:09.781077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.780991    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:21:09.781258 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.781193    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:21:09.781258 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.781216    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.781365 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.781265    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.781447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.781428    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:21:09.781556 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.781531    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:21:09.782762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.782737    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:21:09.782863 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.782837    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:21:09.783382 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.783361    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:21:09.783382 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.783362    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6" pod "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" (UID: "e01ebc0c-ea87-4ffe-81a4-95f6a6d06245"). InnerVolumeSpecName "kube-api-access-f5mp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:21:09.881852 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881831    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.881852 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881851    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.882014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881861    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.882014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881870    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.882014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881878    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.882014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881887    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5mp6\" (UniqueName: \"kubernetes.io/projected/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-kube-api-access-f5mp6\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:09.882014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:09.881896    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:10.176806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:10.176780    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 01:21:10.182852 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:10.182826    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg"]
Oct 31 01:21:11.778183 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:11.778148    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" path="/var/lib/kubelet/pods/e01ebc0c-ea87-4ffe-81a4-95f6a6d06245/volumes"
Oct 31 01:21:18.768114 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:18.768081    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:18.964877 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:18.964850    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:28.718216 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:28.718188    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:21:32.745191 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:32.745157    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:37.234447 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:21:37.234407    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:21:49.855620 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.855563    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856072    7559 cpu_manager.go:414] "containerMap: removing container" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856092    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856114    7559 cpu_manager.go:414] "containerMap: removing container" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856122    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856201    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.856221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.856210    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="e01ebc0c-ea87-4ffe-81a4-95f6a6d06245" containerName="istio-proxy"
Oct 31 01:21:49.859237 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.859212    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.909837 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.909811    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 01:21:49.955389 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.955368    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 01:21:49.955494 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.955422    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 01:21:49.955494 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.955464    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-q9j8d\""
Oct 31 01:21:49.957110 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.957076    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:21:49.992303 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992271    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992426 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992312    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992426 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992336    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj5k\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992552 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992462    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992552 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992519    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992698 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992615    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992698 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992662    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992774 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992746    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:49.992806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:49.992772    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093185    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093212 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093216    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093237    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093256    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093283    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj5k\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093310    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093353    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093381    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093419    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093704    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093722    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.093787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.093779    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.094088 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.094041    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.094368 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.094346    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.095839 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.095816    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.096028 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.096012    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.152867 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.152810    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.152969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.152945    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj5k\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\") pod \"openshift-ai-inference-openshift-default-568c495856-5jnbs\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.171555 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.171535    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:50.594299 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.590174    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:21:50.594424 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:21:50.594392    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8029aeef_6489_454d_a666_c97e0ba4c35b.slice/crio-14b91aed390db04610fc4acf3d868ffc526997c943d561b1fdab3e4ce3989963 WatchSource:0}: Error finding container 14b91aed390db04610fc4acf3d868ffc526997c943d561b1fdab3e4ce3989963: Status 404 returned error can't find the container with id 14b91aed390db04610fc4acf3d868ffc526997c943d561b1fdab3e4ce3989963
Oct 31 01:21:50.596800 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.596767    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:21:50.596895 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.596843    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:21:50.596895 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.596878    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:21:50.922025 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.921989    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" event={"ID":"8029aeef-6489-454d-a666-c97e0ba4c35b","Type":"ContainerStarted","Data":"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"}
Oct 31 01:21:50.922414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:50.922055    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" event={"ID":"8029aeef-6489-454d-a666-c97e0ba4c35b","Type":"ContainerStarted","Data":"14b91aed390db04610fc4acf3d868ffc526997c943d561b1fdab3e4ce3989963"}
Oct 31 01:21:51.172456 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:51.172375    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:51.173931 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:51.173908    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:51.174053 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:51.173954    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:52.172025 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:52.171989    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:52.172412 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:52.172039    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:53.172867 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:53.172832    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:53.173278 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:53.172882    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:54.172066 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:54.172026    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:54.172233 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:54.172080    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:55.172073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:55.172039    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:55.172466 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:55.172090    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:56.073505 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:56.073465    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:21:56.172770 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:56.172740    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 31 01:21:56.173130 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:56.172789    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 31 01:21:57.176547 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:57.176516    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:57.176997 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:57.176809    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:57.177427 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:57.177409    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:21:57.342873 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:21:57.342825    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podStartSLOduration=8.342813883 podStartE2EDuration="8.342813883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:21:51.042573028 +0000 UTC m=+3115.417468249" watchObservedRunningTime="2026-10-31 01:21:57.342813883 +0000 UTC m=+3121.717709097"
Oct 31 01:22:04.978762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:04.978731    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"]
Oct 31 01:22:04.983268 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:04.983252    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.025227 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.025201    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"]
Oct 31 01:22:05.028543 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.028524    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.033454 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033395    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe78532-2064-4c31-9ad2-c543c7f56f34-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033630 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033484    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033630 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033506    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033630 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033534    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033827 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033683    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033827 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033733    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033827 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033758    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hthtp\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-kube-api-access-hthtp\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.033827 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033789    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.034038 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.033975    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.079908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.079879    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"]
Oct 31 01:22:05.127959 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.127935    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"]
Oct 31 01:22:05.135338 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135317    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135434 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135343    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xf8b\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-kube-api-access-5xf8b\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135434 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135363    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98093bc-60db-4278-980b-5468949d6284-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135510 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135430    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe78532-2064-4c31-9ad2-c543c7f56f34-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.135510 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135478    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98093bc-60db-4278-980b-5468949d6284-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135583 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135538    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.135583 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135559    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.135583 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135577    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135705 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135616    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.135803 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135781    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.135868 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135827    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.135868 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135857    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.136013 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.135993    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136095 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136074    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136158 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136111    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hthtp\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-kube-api-access-hthtp\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136158 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136138    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.136260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136164    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136168    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe78532-2064-4c31-9ad2-c543c7f56f34-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136196    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136233    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.136467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136413    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136456    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.136692 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.136674    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.138455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.138431    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.138804 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.138780    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.195344 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.195325    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.195705 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.195688    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hthtp\" (UniqueName: \"kubernetes.io/projected/dfe78532-2064-4c31-9ad2-c543c7f56f34-kube-api-access-hthtp\") pod \"openshift-ai-inference-openshift-default-568c495856-fvvvx\" (UID: \"dfe78532-2064-4c31-9ad2-c543c7f56f34\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.237461 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237395    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237461 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237437    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237656 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237483    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237656 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237508    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf8b\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-kube-api-access-5xf8b\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237656 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237535    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98093bc-60db-4278-980b-5468949d6284-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237656 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237574    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98093bc-60db-4278-980b-5468949d6284-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237882 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237722    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237882 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237777    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.237882 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237823    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.238026 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.237974    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.238085 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.238026    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.238284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.238227    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.238284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.238255    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.238529 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.238369    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98093bc-60db-4278-980b-5468949d6284-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.239966 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.239942    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98093bc-60db-4278-980b-5468949d6284-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.240046 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.240011    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98093bc-60db-4278-980b-5468949d6284-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.295209 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.295188    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:05.296660 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.296640    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xf8b\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-kube-api-access-5xf8b\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.296725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.296702    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98093bc-60db-4278-980b-5468949d6284-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-npztz\" (UID: \"e98093bc-60db-4278-980b-5468949d6284\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.340433 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.340406    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:05.714051 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.714027    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"]
Oct 31 01:22:05.716566 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:22:05.716540    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe78532_2064_4c31_9ad2_c543c7f56f34.slice/crio-a38844fae01e7d9cab68868712c0ec7cdb025616a024da3441e48953ace83747 WatchSource:0}: Error finding container a38844fae01e7d9cab68868712c0ec7cdb025616a024da3441e48953ace83747: Status 404 returned error can't find the container with id a38844fae01e7d9cab68868712c0ec7cdb025616a024da3441e48953ace83747
Oct 31 01:22:05.718588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.718556    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:05.718726 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.718656    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:05.718726 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.718701    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:05.764875 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.764782    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"]
Oct 31 01:22:05.768552 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:22:05.768528    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98093bc_60db_4278_980b_5468949d6284.slice/crio-8778bb0f5b20bac8f34c7aa8c0a9fb77e1ad2fde44f39c86633c8c31695b70c8 WatchSource:0}: Error finding container 8778bb0f5b20bac8f34c7aa8c0a9fb77e1ad2fde44f39c86633c8c31695b70c8: Status 404 returned error can't find the container with id 8778bb0f5b20bac8f34c7aa8c0a9fb77e1ad2fde44f39c86633c8c31695b70c8
Oct 31 01:22:05.770831 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.770796    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:05.770910 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.770882    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:05.770948 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:05.770929    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:22:06.007301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.007202    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" event={"ID":"e98093bc-60db-4278-980b-5468949d6284","Type":"ContainerStarted","Data":"55799472f7a627a86a15bab271bc501e9ce8ddcfd1c3787f0ce24bfc7cdcba31"}
Oct 31 01:22:06.007301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.007266    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" event={"ID":"e98093bc-60db-4278-980b-5468949d6284","Type":"ContainerStarted","Data":"8778bb0f5b20bac8f34c7aa8c0a9fb77e1ad2fde44f39c86633c8c31695b70c8"}
Oct 31 01:22:06.008952 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.008918    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" event={"ID":"dfe78532-2064-4c31-9ad2-c543c7f56f34","Type":"ContainerStarted","Data":"9247f8c148416487fc8d19bea183699a977ba0b8df0b9c3267cc8bf9bfdb7539"}
Oct 31 01:22:06.009071 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.008964    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" event={"ID":"dfe78532-2064-4c31-9ad2-c543c7f56f34","Type":"ContainerStarted","Data":"a38844fae01e7d9cab68868712c0ec7cdb025616a024da3441e48953ace83747"}
Oct 31 01:22:06.259792 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.259673    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podStartSLOduration=2.2596533770000002 podStartE2EDuration="2.259653377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:22:06.127435962 +0000 UTC m=+3130.502331185" watchObservedRunningTime="2026-10-31 01:22:06.259653377 +0000 UTC m=+3130.634548598"
Oct 31 01:22:06.260348 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.260310    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podStartSLOduration=2.260300086 podStartE2EDuration="2.260300086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:22:06.258559222 +0000 UTC m=+3130.633454469" watchObservedRunningTime="2026-10-31 01:22:06.260300086 +0000 UTC m=+3130.635195309"
Oct 31 01:22:06.295638 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.295589    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:06.296969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.296942    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:06.297084 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.296988    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:06.344337 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.344102    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:06.344337 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.344236    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:06.344337 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:06.344276    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:07.280236 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:22:07.280186    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:22:07.296067 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:07.296039    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:07.296203 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:07.296114    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:07.344622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:07.344103    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:07.344622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:07.344189    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:08.296069 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:08.296028    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:08.296549 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:08.296084    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:08.346626 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:08.344000    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:08.346626 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:08.344062    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:09.295720 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:09.295679    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:09.295902 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:09.295739    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:09.346624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:09.346015    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:09.346624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:09.346089    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:10.295830 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:10.295782    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:10.296059 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:10.295857    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:10.317318 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:10.317280    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:22:10.343622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:10.341014    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:10.343622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:10.341095    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:11.296033 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:11.295999    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-fvvvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 31 01:22:11.296457 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:11.296056    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx" podUID="dfe78532-2064-4c31-9ad2-c543c7f56f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 31 01:22:11.345624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:11.344991    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-npztz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 31 01:22:11.345624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:11.345055    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz" podUID="e98093bc-60db-4278-980b-5468949d6284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 31 01:22:12.299905 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.299873    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:12.300323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.300141    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:12.300772 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.300757    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx"
Oct 31 01:22:12.344279 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.344250    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:12.344532 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.344510    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:12.345144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:12.345125    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz"
Oct 31 01:22:37.233528 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:22:37.233486    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:22:56.401720 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:22:56.401688    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:07.234040 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:23:07.234003    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:23:12.783167 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:12.783126    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:23:12.859476 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:12.859447    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:13.065525 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:13.065432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:18.717776 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:18.717730    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:23:27.802684 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:27.802645    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main" containerID="cri-o://99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d" gracePeriod=45
Oct 31 01:23:28.718310 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:28.718275    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:23:34.832617 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:34.832569    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:35.062927 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:35.062859    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:37.234236 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:23:37.234198    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:23:38.717914 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:38.717876    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:23:38.718287 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:38.717993    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:23:48.717447 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:48.717412    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:23:54.840508 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:54.840466    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:55.043450 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:55.043424    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:55.295930 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:55.295900    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:55.651078 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:55.651005    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:55.853062 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:55.853024    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:56.718885 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:56.718848    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:57.856231 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:57.856200    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:58.047247 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.047223    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:23:58.194995 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.194960    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\" (UniqueName: \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\") pod \"60135ca1-a79f-4166-9f51-448e31575280\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") "
Oct 31 01:23:58.195158 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.195056    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\" (UniqueName: \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\") pod \"60135ca1-a79f-4166-9f51-448e31575280\" (UID: \"60135ca1-a79f-4166-9f51-448e31575280\") "
Oct 31 01:23:58.197324 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.197294    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs" pod "60135ca1-a79f-4166-9f51-448e31575280" (UID: "60135ca1-a79f-4166-9f51-448e31575280"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:23:58.197324 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.197311    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs" pod "60135ca1-a79f-4166-9f51-448e31575280" (UID: "60135ca1-a79f-4166-9f51-448e31575280"). InnerVolumeSpecName "kube-api-access-jmlvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:23:58.295925 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.295887    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60135ca1-a79f-4166-9f51-448e31575280-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:23:58.295925 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.295922    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmlvs\" (UniqueName: \"kubernetes.io/projected/60135ca1-a79f-4166-9f51-448e31575280-kube-api-access-jmlvs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:23:58.496953 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.496868    7559 generic.go:356] "Generic (PLEG): container finished" podID="60135ca1-a79f-4166-9f51-448e31575280" containerID="99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d" exitCode=0
Oct 31 01:23:58.496953 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.496921    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"
Oct 31 01:23:58.497159 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.496951    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" event={"ID":"60135ca1-a79f-4166-9f51-448e31575280","Type":"ContainerDied","Data":"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"}
Oct 31 01:23:58.497159 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.497000    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh" event={"ID":"60135ca1-a79f-4166-9f51-448e31575280","Type":"ContainerDied","Data":"b7e05b169c84badfbd6ac8f88ea9d0023085a1a2c7a561cd2d6da439f00ef9d3"}
Oct 31 01:23:58.497159 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.497021    7559 scope.go:122] "RemoveContainer" containerID="99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"
Oct 31 01:23:58.506351 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.506335    7559 scope.go:122] "RemoveContainer" containerID="99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"
Oct 31 01:23:58.506589 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:23:58.506571    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d\": container with ID starting with 99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d not found: ID does not exist" containerID="99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"
Oct 31 01:23:58.506671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.506617    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d"} err="failed to get container status \"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d\": rpc error: code = NotFound desc = could not find container \"99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d\": container with ID starting with 99e1b00455b8b71d3663bfea7527cba69f8a95a2121c22a59379159efc54a51d not found: ID does not exist"
Oct 31 01:23:58.616149 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.616115    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:23:58.665483 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.665461    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:23:58.671576 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:58.671559    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dr5pfh"]
Oct 31 01:23:59.777955 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:23:59.777913    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60135ca1-a79f-4166-9f51-448e31575280" path="/var/lib/kubelet/pods/60135ca1-a79f-4166-9f51-448e31575280/volumes"
Oct 31 01:24:00.201723 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:00.201690    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:00.390763 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:00.390707    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:00.577523 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:00.577421    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:01.596119 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:01.596085    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:02.293467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:02.293435    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:02.488473 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:02.488439    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:07.234488 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:24:07.234409    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:24:07.332996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:07.332964    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:08.055154 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:08.055105    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:08.253586 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:08.253555    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:14.643653 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:14.643583    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:29.489886 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.489854    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:29.890380 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.890298    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:24:29.890776 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.890758    7559 cpu_manager.go:414] "containerMap: removing container" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main"
Oct 31 01:24:29.890896 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.890778    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main"
Oct 31 01:24:29.890896 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.890861    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="60135ca1-a79f-4166-9f51-448e31575280" containerName="main"
Oct 31 01:24:29.893965 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.893945    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.955038 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.955012    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.955165 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.955081    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.955165 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.955118    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.955165 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.955144    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.955287 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.955267    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:29.990796 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.990767    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"default-dockercfg-j6xmj\""
Oct 31 01:24:29.990908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.990798    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"openshift-service-ca.crt\""
Oct 31 01:24:29.990908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.990807    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"lora-pvc-adapters-test-kserve-self-signed-certs\""
Oct 31 01:24:29.990908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.990859    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-with-lora-adapters-a290d4b0\"/\"kube-root-ca.crt\""
Oct 31 01:24:29.991683 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:29.991662    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:24:30.056044 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056022    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056148 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056061    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056148 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056087    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056148 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056126    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmfd\" (UniqueName: \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056319 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056156    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056319 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056171    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056471 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056453    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056531 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056505    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.056653 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.056621    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.058454 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.058437    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.058750 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.058733    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.157406 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.157387    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmfd\" (UniqueName: \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:30.217104 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:30.217078    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmfd\" (UniqueName: \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:31.111805 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:31.111772    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:37.205725 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:37.205690    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:37.233744 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:24:37.233705    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:24:38.339815 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:38.339777    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:39.034834 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.034796    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.134456 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.134424    7559 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") device path: \"\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.135719 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.135696    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.135860 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.135840    7559 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") DevicePath \"\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.185178 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.185148    7559 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") DevicePath \"csi-d1670f85860a12352cc606127e3515301ad532a66d361cff25c563fa277bb10d\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.330669 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.330636    7559 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/3cd41d0745fdb09edb7f8ffc0d307a1def7432292f2a29e1de776e8cfe5262fd/globalmount\"" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.397017 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.396991    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") " pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.506365 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.506334    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:24:39.969148 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.969115    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:24:39.972121 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:24:39.972093    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b242dd_4713_4d05_81db_fad28808739d.slice/crio-68fb24076fb1789902ca3c9c4e263c320958201d81d1670f61f4ee3d813ed5f1 WatchSource:0}: Error finding container 68fb24076fb1789902ca3c9c4e263c320958201d81d1670f61f4ee3d813ed5f1: Status 404 returned error can't find the container with id 68fb24076fb1789902ca3c9c4e263c320958201d81d1670f61f4ee3d813ed5f1
Oct 31 01:24:39.974174 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:39.974152    7559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 01:24:40.675457 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:40.675421    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" event={"ID":"79b242dd-4713-4d05-81db-fad28808739d","Type":"ContainerStarted","Data":"68fb24076fb1789902ca3c9c4e263c320958201d81d1670f61f4ee3d813ed5f1"}
Oct 31 01:24:42.211756 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:42.211719    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:43.738903 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:43.738868    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:43.945213 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:43.945165    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:50.487314 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:50.487231    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:24:57.066416 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:24:57.066374    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:25:07.236234 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:25:07.236169    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:25:09.827429 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:09.827394    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" event={"ID":"79b242dd-4713-4d05-81db-fad28808739d","Type":"ContainerStarted","Data":"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"}
Oct 31 01:25:10.507264 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:10.507233    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:25:19.507090 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:19.507048    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:25:19.508788 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:19.508761    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:25:29.506820 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:29.506769    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:25:37.234205 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:25:37.234159    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:25:39.507398 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:39.507350    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:25:49.507505 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:49.507462    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:25:57.482755 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:57.482721    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:25:59.506974 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:25:59.506931    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:26:07.236218 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:26:07.236172    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:26:09.507402 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:09.507347    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:26:12.390661 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:12.390593    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:19.506847 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:19.506800    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Oct 31 01:26:29.516756 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:29.516725    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:26:29.524052 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:29.524030    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:26:29.719851 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:29.719803    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podStartSLOduration=91.449901639 podStartE2EDuration="2m0.719791901s" totalImagesPullingTime="29.269890262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:25:09.946542548 +0000 UTC m=+3314.321437771" watchObservedRunningTime="2026-10-31 01:26:29.719791901 +0000 UTC m=+3394.094687121"
Oct 31 01:26:31.798718 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:31.798685    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:32.136252 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:32.136173    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:37.233889 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:26:37.233851    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:26:38.530619 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:38.530563    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:38.806593 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:38.806517    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:39.925772 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:39.925736    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:40.128988 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:40.128946    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:40.479344 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:40.479312    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:45.742947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:45.742916    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:45.965141 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:45.965106    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:52.146516 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:52.146467    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:26:56.741199 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:56.741165    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-with-lora-adapters-a290d4b0_lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv_79b242dd-4713-4d05-81db-fad28808739d/main/0.log"
Oct 31 01:26:57.740487 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:26:57.740394    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:01.580515 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:01.580476    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:27:01.684778 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:01.684743    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:07.233739 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:27:07.233659    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:27:16.602798 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:16.602738    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main" containerID="cri-o://0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0" gracePeriod=45
Oct 31 01:27:17.068512 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:27:17.068478    7559 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b242dd_4713_4d05_81db_fad28808739d.slice/crio-conmon-0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 01:27:17.249726 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.249696    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:27:17.388649 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388564    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\" (UniqueName: \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.388649 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388642    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\" (UniqueName: \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.388870 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388698    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.388870 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388717    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.388870 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388762    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.389063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388880    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.389063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.388913    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\") pod \"79b242dd-4713-4d05-81db-fad28808739d\" (UID: \"79b242dd-4713-4d05-81db-fad28808739d\") "
Oct 31 01:27:17.389348 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.389325    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:17.389558 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.389536    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:17.391328 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.391297    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:17.391538 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.391510    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:27:17.391649 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.391516    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "kube-api-access-ttmfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:27:17.398886 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.398864    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 31 01:27:17.400101 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.400079    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir" pod "79b242dd-4713-4d05-81db-fad28808739d" (UID: "79b242dd-4713-4d05-81db-fad28808739d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:17.402683 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.402657    7559 generic.go:356] "Generic (PLEG): container finished" podID="79b242dd-4713-4d05-81db-fad28808739d" containerID="0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0" exitCode=0
Oct 31 01:27:17.402763 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.402714    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"
Oct 31 01:27:17.402808 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.402766    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" event={"ID":"79b242dd-4713-4d05-81db-fad28808739d","Type":"ContainerDied","Data":"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"}
Oct 31 01:27:17.402883 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.402867    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv" event={"ID":"79b242dd-4713-4d05-81db-fad28808739d","Type":"ContainerDied","Data":"68fb24076fb1789902ca3c9c4e263c320958201d81d1670f61f4ee3d813ed5f1"}
Oct 31 01:27:17.402924 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.402905    7559 scope.go:122] "RemoveContainer" containerID="0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"
Oct 31 01:27:17.412897 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.412877    7559 scope.go:122] "RemoveContainer" containerID="0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"
Oct 31 01:27:17.413155 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:27:17.413135    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0\": container with ID starting with 0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0 not found: ID does not exist" containerID="0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"
Oct 31 01:27:17.413219 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.413167    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0"} err="failed to get container status \"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0\": rpc error: code = NotFound desc = could not find container \"0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0\": container with ID starting with 0f3c1082e7295bbc50caf548b03eaa322feee3de97daede0bc377a4f08ad16d0 not found: ID does not exist"
Oct 31 01:27:17.490189 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490156    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b242dd-4713-4d05-81db-fad28808739d-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.490189 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490192    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttmfd\" (UniqueName: \"kubernetes.io/projected/79b242dd-4713-4d05-81db-fad28808739d-kube-api-access-ttmfd\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.490378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490208    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.490378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490221    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.490378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490232    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.490378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490270    7559 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" "
Oct 31 01:27:17.490378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.490284    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b242dd-4713-4d05-81db-fad28808739d-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:17.519007 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.518987    7559 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586") on node "ip-10-0-143-57.us-west-2.compute.internal"
Oct 31 01:27:17.564839 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.564812    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:27:17.570448 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.570420    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-with-lora-adapters-a290d4b0/lora-pvc-adapters-test-kserve-55d4fd88bc-ngpxv"]
Oct 31 01:27:17.590845 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.590823    7559 reconciler_common.go:299] "Volume detached for volume \"pvc-ec5bdde6-46c0-4edb-9a26-6ff01a632858\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b1b72cd7aeb1e586\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"csi-d1670f85860a12352cc606127e3515301ad532a66d361cff25c563fa277bb10d\""
Oct 31 01:27:17.778707 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:17.778673    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79b242dd-4713-4d05-81db-fad28808739d" path="/var/lib/kubelet/pods/79b242dd-4713-4d05-81db-fad28808739d/volumes"
Oct 31 01:27:21.942299 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:21.942269    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:22.150634 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.150588    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:22.365170 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.365091    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:22.410894 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.410863    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:27:22.411083 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.411058    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" containerID="cri-o://29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658" gracePeriod=30
Oct 31 01:27:22.531668 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.531637    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:27:22.532005 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.531993    7559 cpu_manager.go:414] "containerMap: removing container" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main"
Oct 31 01:27:22.532052 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.532006    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main"
Oct 31 01:27:22.532106 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.532080    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="79b242dd-4713-4d05-81db-fad28808739d" containerName="main"
Oct 31 01:27:22.536762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.536739    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.590732 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.590689    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"kube-root-ca.crt\""
Oct 31 01:27:22.590947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.590723    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"openshift-gw-ca-root-cert\""
Oct 31 01:27:22.590947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.590738    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"model-routing-only-gateway-openshift-default-dockercfg-69vmh\""
Oct 31 01:27:22.591093 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.590739    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"openshift-service-ca.crt\""
Oct 31 01:27:22.600176 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.600154    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:27:22.632954 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.632895    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.632954 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.632934    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633102 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.632964    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633102 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633058    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633102 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633087    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633224 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633109    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633224 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633130    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633224 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633194    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.633393 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.633352    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnwv\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.687860 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.687830    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:22.734758 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734733    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.734913 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734761    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.734913 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734785    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnwv\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.734913 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734842    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.734913 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734860    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.734913 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734883    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734930    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734959    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.734979    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735315 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.735223    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735315 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.735268    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735419 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.735385    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735615 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.735573    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.735769 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.735746    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.737399 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.737375    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.737791 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.737774    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.794664 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.794636    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.794762 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.794721    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnwv\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\") pod \"model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.858711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.858684    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:22.883987 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:22.883931    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:23.278467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.278436    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:27:23.282017 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:27:23.281986    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09887ee4_a590_43ec_a1ea_35e82e27ac6f.slice/crio-b78ce9b4d702bb284f65443f83bd8b06e0e97e55d79a49863c1cd71a69c3e8f5 WatchSource:0}: Error finding container b78ce9b4d702bb284f65443f83bd8b06e0e97e55d79a49863c1cd71a69c3e8f5: Status 404 returned error can't find the container with id b78ce9b4d702bb284f65443f83bd8b06e0e97e55d79a49863c1cd71a69c3e8f5
Oct 31 01:27:23.284006 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.283976    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:23.284080 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.284046    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:23.284080 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.284072    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:23.431475 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.431437    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerStarted","Data":"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"}
Oct 31 01:27:23.431711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.431502    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerStarted","Data":"b78ce9b4d702bb284f65443f83bd8b06e0e97e55d79a49863c1cd71a69c3e8f5"}
Oct 31 01:27:23.547019 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.546787    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podStartSLOduration=1.546772512 podStartE2EDuration="1.546772512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:27:23.546024277 +0000 UTC m=+3447.920919497" watchObservedRunningTime="2026-10-31 01:27:23.546772512 +0000 UTC m=+3447.921667735"
Oct 31 01:27:23.859621 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:23.859525    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:24.863727 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:24.863699    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:25.440361 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:25.440333    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:25.441299 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:25.441278    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:27.178839 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.178808    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-5jnbs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 01:27:27.179206 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.178864    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 01:27:27.233568 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.233540    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:27.438734 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.438708    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:27.652933 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.652911    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:27:27.670860 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.670837    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.670967 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.670868    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.670967 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.670916    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.670967 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.670939    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671123 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.670968    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671123 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671038    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671123 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671093    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671276 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671119    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671276 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671137    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:27.671276 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671158    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\") pod \"8029aeef-6489-454d-a666-c97e0ba4c35b\" (UID: \"8029aeef-6489-454d-a666-c97e0ba4c35b\") "
Oct 31 01:27:27.671276 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671192    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:27.671473 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671394    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:27.671473 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671463    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.671580 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671480    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.671580 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671496    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.671580 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671559    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:27.671764 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.671679    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:27:27.673453 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.673425    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "kube-api-access-mgj5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:27:27.673453 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.673438    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:27:27.673678 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.673661    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:27:27.673744 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.673680    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token" pod "8029aeef-6489-454d-a666-c97e0ba4c35b" (UID: "8029aeef-6489-454d-a666-c97e0ba4c35b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:27:27.772809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772743    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.772809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772775    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.772809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772789    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.772809 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772803    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8029aeef-6489-454d-a666-c97e0ba4c35b-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.773040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772820    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgj5k\" (UniqueName: \"kubernetes.io/projected/8029aeef-6489-454d-a666-c97e0ba4c35b-kube-api-access-mgj5k\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:27.773040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:27.772834    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8029aeef-6489-454d-a666-c97e0ba4c35b-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:27:28.454378 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.454343    7559 generic.go:356] "Generic (PLEG): container finished" podID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerID="29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658" exitCode=0
Oct 31 01:27:28.454818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.454411    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"
Oct 31 01:27:28.454818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.454424    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" event={"ID":"8029aeef-6489-454d-a666-c97e0ba4c35b","Type":"ContainerDied","Data":"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"}
Oct 31 01:27:28.454818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.454505    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs" event={"ID":"8029aeef-6489-454d-a666-c97e0ba4c35b","Type":"ContainerDied","Data":"14b91aed390db04610fc4acf3d868ffc526997c943d561b1fdab3e4ce3989963"}
Oct 31 01:27:28.454818 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.454528    7559 scope.go:122] "RemoveContainer" containerID="29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"
Oct 31 01:27:28.463006 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.462984    7559 scope.go:122] "RemoveContainer" containerID="29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"
Oct 31 01:27:28.463260 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:27:28.463242    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658\": container with ID starting with 29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658 not found: ID does not exist" containerID="29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"
Oct 31 01:27:28.463326 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.463272    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658"} err="failed to get container status \"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658\": rpc error: code = NotFound desc = could not find container \"29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658\": container with ID starting with 29026693d4626bf196e23b5c69456a6ad53461c828a48bb6b84382775dbce658 not found: ID does not exist"
Oct 31 01:27:28.611202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.611176    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:27:28.657720 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.657700    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs"]
Oct 31 01:27:28.964663 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:28.964633    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:29.430886 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.430856    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:27:29.431215 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.431203    7559 cpu_manager.go:414] "containerMap: removing container" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy"
Oct 31 01:27:29.431258 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.431216    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy"
Oct 31 01:27:29.431295 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.431267    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" containerName="istio-proxy"
Oct 31 01:27:29.435795 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.435774    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488540 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488504    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488542    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488561    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488678    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488700    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmntt\" (UniqueName: \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.488969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.488742    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.531780 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.531748    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"default-dockercfg-bmbq7\""
Oct 31 01:27:29.531906 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.531843    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-f772d59b\"/\"model-routing-only-7aad4d71-kserve-self-signed-certs\""
Oct 31 01:27:29.533115 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.533098    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:27:29.589666 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589639    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.589789 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589670    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.589789 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589712    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.589789 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589729    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmntt\" (UniqueName: \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.589789 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589778    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.589984 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.589800    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.590034 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.590022    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.590118 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.590098    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.590177 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.590150    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.592153 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.592127    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.592332 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.592317    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.617312 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.617291    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:29.649105 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.649079    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmntt\" (UniqueName: \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") " pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.747976 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.747902    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:29.779588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:29.779555    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8029aeef-6489-454d-a666-c97e0ba4c35b" path="/var/lib/kubelet/pods/8029aeef-6489-454d-a666-c97e0ba4c35b/volumes"
Oct 31 01:27:30.116036 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.115969    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:27:30.119197 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:27:30.119169    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6518abf3_b719_4b85_993e_b9313ab92cd1.slice/crio-45441fd8642725500128ce5425ae6d515f1908bede40321b970ef234c3f59dd5 WatchSource:0}: Error finding container 45441fd8642725500128ce5425ae6d515f1908bede40321b970ef234c3f59dd5: Status 404 returned error can't find the container with id 45441fd8642725500128ce5425ae6d515f1908bede40321b970ef234c3f59dd5
Oct 31 01:27:30.466249 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.466215    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" event={"ID":"6518abf3-b719-4b85-993e-b9313ab92cd1","Type":"ContainerStarted","Data":"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"}
Oct 31 01:27:30.466429 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.466271    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" event={"ID":"6518abf3-b719-4b85-993e-b9313ab92cd1","Type":"ContainerStarted","Data":"45441fd8642725500128ce5425ae6d515f1908bede40321b970ef234c3f59dd5"}
Oct 31 01:27:30.498850 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.498820    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:30.578025 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.577955    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" podStartSLOduration=1.577916483 podStartE2EDuration="1.577916483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:27:30.577542654 +0000 UTC m=+3454.952437876" watchObservedRunningTime="2026-10-31 01:27:30.577916483 +0000 UTC m=+3454.952811704"
Oct 31 01:27:30.691969 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.691932    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:30.748463 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:30.748397    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:35.212226 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:35.212188    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:35.422014 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:35.421978    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:27:37.253727 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:27:37.253687    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:27:39.748110 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:39.748082    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:39.760368 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:39.760347    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:40.442077 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.442011    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:40.512336 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.512271    7559 generic.go:356] "Generic (PLEG): container finished" podID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerID="30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab" exitCode=0
Oct 31 01:27:40.512467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.512340    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerDied","Data":"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"}
Oct 31 01:27:40.512847 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.512828    7559 scope.go:122] "RemoveContainer" containerID="30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"
Oct 31 01:27:40.513868 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.513843    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:40.513956 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.513914    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:40.513956 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.513942    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:27:40.524142 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:40.524122    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:27:41.518908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:41.518872    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerStarted","Data":"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"}
Oct 31 01:27:41.859642 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:41.859522    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:41.859805 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:41.859770    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:42.859082 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:42.859038    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:43.859366 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:43.859324    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:44.859349 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:44.859306    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:45.859461 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:45.859413    7559 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 31 01:27:46.863726 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:46.863696    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:46.864217 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:46.863980    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:46.864863 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:46.864844    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:27:58.078952 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:27:58.078915    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:07.234086 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:07.234049    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:28:20.440340 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:20.440305    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:20.646644 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:20.646616    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:20.841404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:20.841317    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:21.049080 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:21.049048    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:37.234315 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:37.234274    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:28:45.021510 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:45.021473    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:45.229797 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:45.229762    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:45.747149 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:45.747119    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:45.960683 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:45.960585    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:49.819580 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:49.819539    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:50.020087 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.020006    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:28:50.029353 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:50.029312    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38" cmd=["/bin/sleep","15"]
Oct 31 01:28:50.029486 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.029359    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 01:28:50.029486 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:50.029372    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerName="main" containerID="cri-o://bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"
Oct 31 01:28:50.029486 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.029420    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerName="main" containerID="cri-o://bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38" gracePeriod=60
Oct 31 01:28:50.066146 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.066117    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:28:50.066418 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.066367    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy" containerID="cri-o://348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450" gracePeriod=30
Oct 31 01:28:50.239156 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.239127    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:50.375319 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.375296    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:28:50.497121 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497087    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\" (UniqueName: \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497157    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497257    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497312    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497404 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497358    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\" (UniqueName: \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497674 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497416    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\") pod \"6518abf3-b719-4b85-993e-b9313ab92cd1\" (UID: \"6518abf3-b719-4b85-993e-b9313ab92cd1\") "
Oct 31 01:28:50.497674 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497483    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:50.497674 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497554    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:50.497844 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497723    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:50.497844 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497799    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.497844 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.497819    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.500201 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.500028    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:28:50.500681 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.500584    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:50.508901 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.508879    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt" pod "6518abf3-b719-4b85-993e-b9313ab92cd1" (UID: "6518abf3-b719-4b85-993e-b9313ab92cd1"). InnerVolumeSpecName "kube-api-access-nmntt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:28:50.599333 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.599259    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.599333 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.599289    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6518abf3-b719-4b85-993e-b9313ab92cd1-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.599333 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.599300    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6518abf3-b719-4b85-993e-b9313ab92cd1-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.599333 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.599313    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmntt\" (UniqueName: \"kubernetes.io/projected/6518abf3-b719-4b85-993e-b9313ab92cd1-kube-api-access-nmntt\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:50.835515 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.835478    7559 generic.go:356] "Generic (PLEG): container finished" podID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerID="bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38" exitCode=0
Oct 31 01:28:50.835926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.835543    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"
Oct 31 01:28:50.835926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.835558    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" event={"ID":"6518abf3-b719-4b85-993e-b9313ab92cd1","Type":"ContainerDied","Data":"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"}
Oct 31 01:28:50.835926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.835625    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g" event={"ID":"6518abf3-b719-4b85-993e-b9313ab92cd1","Type":"ContainerDied","Data":"45441fd8642725500128ce5425ae6d515f1908bede40321b970ef234c3f59dd5"}
Oct 31 01:28:50.835926 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.835647    7559 scope.go:122] "RemoveContainer" containerID="bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"
Oct 31 01:28:50.846636 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.846579    7559 scope.go:122] "RemoveContainer" containerID="bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"
Oct 31 01:28:50.846994 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:50.846971    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38\": container with ID starting with bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38 not found: ID does not exist" containerID="bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"
Oct 31 01:28:50.847092 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.847004    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38"} err="failed to get container status \"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38\": rpc error: code = NotFound desc = could not find container \"bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38\": container with ID starting with bc5de42494f8737ec8c793fc0a47e5fc7129bdbe07b7351e1251a0c28ac71b38 not found: ID does not exist"
Oct 31 01:28:50.992590 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.992566    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:28:50.998745 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:50.998725    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-7aad4d71-kserve-6557db66dd-zrh6g"]
Oct 31 01:28:51.778550 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:51.778517    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" path="/var/lib/kubelet/pods/6518abf3-b719-4b85-993e-b9313ab92cd1/volumes"
Oct 31 01:28:53.538903 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:53.538864    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:28:55.313767 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.313742    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:28:55.437103 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437079    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437233 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437137    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437233 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437200    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437239    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437277    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437304    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437483 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437333    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437483 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437332    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:55.437483 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437367    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437483 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437442    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\") pod \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\" (UID: \"09887ee4-a590-43ec-a1ea-35e82e27ac6f\") "
Oct 31 01:28:55.437703 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437506    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:28:55.437703 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437619    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:55.437703 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437642    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:55.437854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437756    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:55.437854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437769    7559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.437854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437789    7559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istiod-ca-cert\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.437854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437807    7559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-workload-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.437854 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.437823    7559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-data\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.439565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.439540    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "kube-api-access-4cnwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:28:55.439792 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.439774    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:28:55.439908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.439893    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:28:55.440206 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.440187    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo" pod "09887ee4-a590-43ec-a1ea-35e82e27ac6f" (UID: "09887ee4-a590-43ec-a1ea-35e82e27ac6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:28:55.538263 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.538235    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cnwv\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-kube-api-access-4cnwv\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.538263 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.538263    7559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-podinfo\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.538437 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.538272    7559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-token\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.538437 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.538281    7559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-istio-envoy\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.538437 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.538289    7559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09887ee4-a590-43ec-a1ea-35e82e27ac6f-credential-socket\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:28:55.859507 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.859475    7559 generic.go:356] "Generic (PLEG): container finished" podID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerID="348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450" exitCode=0
Oct 31 01:28:55.859680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.859547    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"
Oct 31 01:28:55.859680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.859553    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerDied","Data":"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"}
Oct 31 01:28:55.859680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.859635    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw" event={"ID":"09887ee4-a590-43ec-a1ea-35e82e27ac6f","Type":"ContainerDied","Data":"b78ce9b4d702bb284f65443f83bd8b06e0e97e55d79a49863c1cd71a69c3e8f5"}
Oct 31 01:28:55.859680 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.859665    7559 scope.go:122] "RemoveContainer" containerID="348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"
Oct 31 01:28:55.868345 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.868330    7559 scope.go:122] "RemoveContainer" containerID="30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"
Oct 31 01:28:55.876008 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.875994    7559 scope.go:122] "RemoveContainer" containerID="348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"
Oct 31 01:28:55.876241 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:55.876223    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450\": container with ID starting with 348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450 not found: ID does not exist" containerID="348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"
Oct 31 01:28:55.876298 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.876254    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450"} err="failed to get container status \"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450\": rpc error: code = NotFound desc = could not find container \"348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450\": container with ID starting with 348f28941228462e62ac014cc6232852272c6adbf9ae47688cec70a525df5450 not found: ID does not exist"
Oct 31 01:28:55.876298 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.876278    7559 scope.go:122] "RemoveContainer" containerID="30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"
Oct 31 01:28:55.876514 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:28:55.876496    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab\": container with ID starting with 30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab not found: ID does not exist" containerID="30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"
Oct 31 01:28:55.876569 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:55.876521    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab"} err="failed to get container status \"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab\": rpc error: code = NotFound desc = could not find container \"30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab\": container with ID starting with 30ea2138c8deb0a5b061fe11968c4c1e74a9fd6a8f7927e3b2e8bb204da555ab not found: ID does not exist"
Oct 31 01:28:56.016940 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:56.016915    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:28:56.022917 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:56.022895    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-model-based-routing-only-f772d59b/model-routing-only-gateway-openshift-default-7fd47b77c-xqlrw"]
Oct 31 01:28:57.778950 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:57.778919    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" path="/var/lib/kubelet/pods/09887ee4-a590-43ec-a1ea-35e82e27ac6f/volumes"
Oct 31 01:28:58.441472 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:28:58.441426    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:07.234118 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:29:07.234033    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:29:10.163662 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:10.163615    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:10.376373 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:10.376341    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:12.303040 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:12.302998    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:12.625265 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:12.625159    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:14.198499 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:14.198467    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:17.531173 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:17.531133    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:18.444414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.444376    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:18.785621 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785520    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785913    7559 cpu_manager.go:414] "containerMap: removing container" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785929    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785950    7559 cpu_manager.go:414] "containerMap: removing container" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785955    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785962    7559 cpu_manager.go:414] "containerMap: removing container" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerName="main"
Oct 31 01:29:18.785996 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.785967    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerName="main"
Oct 31 01:29:18.786181 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.786013    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.786181 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.786020    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="6518abf3-b719-4b85-993e-b9313ab92cd1" containerName="main"
Oct 31 01:29:18.786181 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.786028    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="09887ee4-a590-43ec-a1ea-35e82e27ac6f" containerName="istio-proxy"
Oct 31 01:29:18.790303 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.790284    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.827284 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.827261    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.827411 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.827322    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbhhm\" (UniqueName: \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.861468 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.861449    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"default-dockercfg-b668w\""
Oct 31 01:29:18.886606 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.886581    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"tls-verification-test-epp-sa-dockercfg-h7wnw\""
Oct 31 01:29:18.886713 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.886696    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"tls-verification-test-kserve-self-signed-certs\""
Oct 31 01:29:18.886759 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.886702    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"openshift-service-ca.crt\""
Oct 31 01:29:18.886759 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.886733    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"kube-root-ca.crt\""
Oct 31 01:29:18.888087 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.888068    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:29:18.925049 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.925026    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:18.927989 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.927964    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbhhm\" (UniqueName: \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.928096 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.928029    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.931636 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.931586    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:18.988348 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:18.988318    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbhhm\" (UniqueName: \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:19.102513 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:19.102451    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:19.470547 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:19.470519    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:29:19.473692 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:29:19.473661    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a65e91_751b_44e8_ac87_afc9aca9702b.slice/crio-a7cfbb0ebd8bbcac812415a2ebabee364bdedbb33726dc280b0f97d7dbfbd402 WatchSource:0}: Error finding container a7cfbb0ebd8bbcac812415a2ebabee364bdedbb33726dc280b0f97d7dbfbd402: Status 404 returned error can't find the container with id a7cfbb0ebd8bbcac812415a2ebabee364bdedbb33726dc280b0f97d7dbfbd402
Oct 31 01:29:19.955287 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:19.955252    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" event={"ID":"73a65e91-751b-44e8-ac87-afc9aca9702b","Type":"ContainerStarted","Data":"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"}
Oct 31 01:29:19.955675 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:19.955304    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" event={"ID":"73a65e91-751b-44e8-ac87-afc9aca9702b","Type":"ContainerStarted","Data":"a7cfbb0ebd8bbcac812415a2ebabee364bdedbb33726dc280b0f97d7dbfbd402"}
Oct 31 01:29:19.955675 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:19.955340    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:20.067588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:20.067541    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podStartSLOduration=2.0675263839999998 podStartE2EDuration="2.067526384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:29:20.066565037 +0000 UTC m=+3564.441460258" watchObservedRunningTime="2026-10-31 01:29:20.067526384 +0000 UTC m=+3564.442421601"
Oct 31 01:29:21.167051 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:21.167018    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:24.436098 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:24.436063    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:24.630057 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:24.629987    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:33.134348 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:33.134309    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:34.341402 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:34.341359    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:37.233956 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:29:37.233919    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:29:37.399675 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.399642    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:37.595713 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.595636    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:29:37.710420 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.710386    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"]
Oct 31 01:29:37.713851 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.713828    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799045 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799016    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799185 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799053    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mhx\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-kube-api-access-84mhx\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799185 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799170    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799274 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799205    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fca93b-2386-4774-9340-022093872a5a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799274 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799254    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799352 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799273    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799352 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799334    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799425 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799369    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fca93b-2386-4774-9340-022093872a5a-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.799425 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.799401    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900375 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900307    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900375 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900367    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fca93b-2386-4774-9340-022093872a5a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900400    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900425    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900460    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900493    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fca93b-2386-4774-9340-022093872a5a-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900533    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900575 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900566    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900935 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900628    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84mhx\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-kube-api-access-84mhx\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900998 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900930    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.900998 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.900975    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-credential-socket\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.901070 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.901015    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-data\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.901115 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.901090    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-workload-certs\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.901239 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.901215    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0fca93b-2386-4774-9340-022093872a5a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.902981 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.902963    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0fca93b-2386-4774-9340-022093872a5a-istio-envoy\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.903074 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.903057    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0fca93b-2386-4774-9340-022093872a5a-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.921041 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.921018    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"]
Oct 31 01:29:37.964334 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.960278    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-istio-token\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:37.965239 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:37.965216    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mhx\" (UniqueName: \"kubernetes.io/projected/f0fca93b-2386-4774-9340-022093872a5a-kube-api-access-84mhx\") pod \"openshift-ai-inference-openshift-default-568c495856-s86wq\" (UID: \"f0fca93b-2386-4774-9340-022093872a5a\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:38.027074 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:38.027048    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:38.443877 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:38.443839    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"]
Oct 31 01:29:38.446897 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:29:38.446861    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fca93b_2386_4774_9340_022093872a5a.slice/crio-2ae8d508e1b52ddd3cfbbba6e733aa2da049de4b2d9a72de52b7d7caf97a476d WatchSource:0}: Error finding container 2ae8d508e1b52ddd3cfbbba6e733aa2da049de4b2d9a72de52b7d7caf97a476d: Status 404 returned error can't find the container with id 2ae8d508e1b52ddd3cfbbba6e733aa2da049de4b2d9a72de52b7d7caf97a476d
Oct 31 01:29:38.448991 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:38.448955    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:29:38.449127 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:38.449019    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:29:38.449127 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:38.449076    7559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 31 01:29:39.053983 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:39.053951    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" event={"ID":"f0fca93b-2386-4774-9340-022093872a5a","Type":"ContainerStarted","Data":"6367e603bcbcb0b7c73e34f2cc1b522994b342d9fc44e03c9bf575e6e5f7f53e"}
Oct 31 01:29:39.054176 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:39.054001    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" event={"ID":"f0fca93b-2386-4774-9340-022093872a5a","Type":"ContainerStarted","Data":"2ae8d508e1b52ddd3cfbbba6e733aa2da049de4b2d9a72de52b7d7caf97a476d"}
Oct 31 01:29:39.218110 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:39.218056    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podStartSLOduration=2.218041818 podStartE2EDuration="2.218041818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:29:39.216813139 +0000 UTC m=+3583.591708363" watchObservedRunningTime="2026-10-31 01:29:39.218041818 +0000 UTC m=+3583.592937039"
Oct 31 01:29:40.042315 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:40.042285    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:40.042960 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:40.042937    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-s86wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 31 01:29:40.043111 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:40.043085    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podUID="f0fca93b-2386-4774-9340-022093872a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 31 01:29:41.049739 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:41.049691    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-s86wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 31 01:29:41.050220 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:41.049755    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podUID="f0fca93b-2386-4774-9340-022093872a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 31 01:29:42.045624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:42.038946    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-s86wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 31 01:29:42.045624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:42.039018    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podUID="f0fca93b-2386-4774-9340-022093872a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 31 01:29:43.040624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:43.032941    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-s86wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 31 01:29:43.040624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:43.033000    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podUID="f0fca93b-2386-4774-9340-022093872a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 31 01:29:44.045624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:44.036953    7559 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-568c495856-s86wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 31 01:29:44.045624 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:44.037018    7559 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq" podUID="f0fca93b-2386-4774-9340-022093872a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 31 01:29:45.031157 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:45.031126    7559 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:45.031411 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:45.031390    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:45.032034 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:45.032015    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq"
Oct 31 01:29:50.963780 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:50.963751    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:29:58.770345 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:29:58.770307    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:30:07.233168 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:30:07.233087    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:30:37.233846 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:30:37.233810    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:30:59.156105 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:30:59.156074    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:07.234441 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:31:07.234404    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:31:11.790896 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:11.790838    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:11.990953 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:11.990911    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:12.197183 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:12.197152    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:12.527138 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:12.527059    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:16.515869 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:16.515841    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:17.319425 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:17.319393    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:22.343290 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.343252    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:22.743406 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.743375    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:31:22.746857 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.746834    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:22.842908 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.842872    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"kube-root-ca.crt\""
Oct 31 01:31:22.843142 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.843123    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"openshift-service-ca.crt\""
Oct 31 01:31:22.843195 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.843144    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-epp-sa-dockercfg-ql2jd\""
Oct 31 01:31:22.843195 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.843127    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"default-dockercfg-4r5wb\""
Oct 31 01:31:22.843195 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.843124    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-kserve-self-signed-certs\""
Oct 31 01:31:22.846788 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.846769    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:31:22.878311 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.878248    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q8dm\" (UniqueName: \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:22.878311 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.878284    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:22.937224 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.937192    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:22.979477 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.979452    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q8dm\" (UniqueName: \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:22.979622 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.979487    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:22.982144 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:22.982122    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:23.039582 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.039553    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q8dm\" (UniqueName: \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:23.058323 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.058303    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:23.424012 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.423979    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:31:23.427546 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:31:23.427505    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a81689e_a39c_4cda_8900_7c00e0b8f493.slice/crio-2f9bdc725b37d7ba8b07a3bc4e51c0d2127462a40d79696294e56824cf0fb382 WatchSource:0}: Error finding container 2f9bdc725b37d7ba8b07a3bc4e51c0d2127462a40d79696294e56824cf0fb382: Status 404 returned error can't find the container with id 2f9bdc725b37d7ba8b07a3bc4e51c0d2127462a40d79696294e56824cf0fb382
Oct 31 01:31:23.490775 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.490746    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" event={"ID":"7a81689e-a39c-4cda-8900-7c00e0b8f493","Type":"ContainerStarted","Data":"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"}
Oct 31 01:31:23.490876 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.490805    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:23.490876 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.490826    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" event={"ID":"7a81689e-a39c-4cda-8900-7c00e0b8f493","Type":"ContainerStarted","Data":"2f9bdc725b37d7ba8b07a3bc4e51c0d2127462a40d79696294e56824cf0fb382"}
Oct 31 01:31:23.602164 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:23.602112    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podStartSLOduration=1.602099764 podStartE2EDuration="1.602099764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:31:23.601188318 +0000 UTC m=+3687.976083556" watchObservedRunningTime="2026-10-31 01:31:23.602099764 +0000 UTC m=+3687.976994985"
Oct 31 01:31:28.324373 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:28.324342    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:30.772588 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:30.772549    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:31:30.872942 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:30.872911    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:30.963399 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:30.963367    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:31:31.078221 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:31.078150    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:36.575347 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:36.575311    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:37.234207 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:31:37.234164    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:31:39.652411 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:39.652373    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:39.963756 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:39.963724    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:40.708848 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:40.708816    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:40.963874 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:40.963799    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:31:45.792636 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:45.792583    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" containerID="cri-o://6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab" gracePeriod=45
Oct 31 01:31:47.033817 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:47.033780    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:50.962899 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:50.962865    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:31:50.963266 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:50.962960    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:31:54.496847 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:54.496821    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:31:56.723745 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:56.723708    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:31:59.450948 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:31:59.450912    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:00.963501 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:00.963465    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:32:02.950302 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:02.950267    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:03.149985 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:03.149952    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:07.233626 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:32:07.233569    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:32:10.963298 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:10.963265    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:32:16.030067 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.030041    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:32:16.127414 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.127343    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\" (UniqueName: \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\") pod \"73a65e91-751b-44e8-ac87-afc9aca9702b\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") "
Oct 31 01:32:16.127533 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.127435    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\" (UniqueName: \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\") pod \"73a65e91-751b-44e8-ac87-afc9aca9702b\" (UID: \"73a65e91-751b-44e8-ac87-afc9aca9702b\") "
Oct 31 01:32:16.129686 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.129650    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs" pod "73a65e91-751b-44e8-ac87-afc9aca9702b" (UID: "73a65e91-751b-44e8-ac87-afc9aca9702b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:32:16.129795 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.129701    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm" pod "73a65e91-751b-44e8-ac87-afc9aca9702b" (UID: "73a65e91-751b-44e8-ac87-afc9aca9702b"). InnerVolumeSpecName "kube-api-access-nbhhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:32:16.228260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.228233    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73a65e91-751b-44e8-ac87-afc9aca9702b-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:32:16.228260 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.228258    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbhhm\" (UniqueName: \"kubernetes.io/projected/73a65e91-751b-44e8-ac87-afc9aca9702b-kube-api-access-nbhhm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:32:16.717411 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.717371    7559 generic.go:356] "Generic (PLEG): container finished" podID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerID="6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab" exitCode=0
Oct 31 01:32:16.717581 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.717423    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"
Oct 31 01:32:16.717581 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.717457    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" event={"ID":"73a65e91-751b-44e8-ac87-afc9aca9702b","Type":"ContainerDied","Data":"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"}
Oct 31 01:32:16.717581 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.717510    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx" event={"ID":"73a65e91-751b-44e8-ac87-afc9aca9702b","Type":"ContainerDied","Data":"a7cfbb0ebd8bbcac812415a2ebabee364bdedbb33726dc280b0f97d7dbfbd402"}
Oct 31 01:32:16.717581 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.717531    7559 scope.go:122] "RemoveContainer" containerID="6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"
Oct 31 01:32:16.726467 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.726448    7559 scope.go:122] "RemoveContainer" containerID="6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"
Oct 31 01:32:16.726779 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:32:16.726753    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab\": container with ID starting with 6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab not found: ID does not exist" containerID="6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"
Oct 31 01:32:16.726862 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.726787    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab"} err="failed to get container status \"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab\": rpc error: code = NotFound desc = could not find container \"6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab\": container with ID starting with 6120744806bbcce7a1772e05b7eaebf175ff47ca085374100fd2dd988c02faab not found: ID does not exist"
Oct 31 01:32:16.875631 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.875594    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:32:16.921802 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:16.921772    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-95sgx"]
Oct 31 01:32:17.777650 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:17.777617    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" path="/var/lib/kubelet/pods/73a65e91-751b-44e8-ac87-afc9aca9702b/volumes"
Oct 31 01:32:20.470671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:20.470638    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:20.671113 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:20.671084    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:20.936497 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:20.936463    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:25.792882 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:25.792847    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:26.352578 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:26.352545    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:28.336870 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:28.336839    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:34.792339 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:34.792296    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:34.994234 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:34.994206    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:35.501015 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:35.500985    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:32:37.234185 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:32:37.234151    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:32:59.780880 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:32:59.780842    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:33:05.160020 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.159933    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:05.160413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.160286    7559 cpu_manager.go:414] "containerMap: removing container" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main"
Oct 31 01:33:05.160413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.160296    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main"
Oct 31 01:33:05.160413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.160360    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="73a65e91-751b-44e8-ac87-afc9aca9702b" containerName="main"
Oct 31 01:33:05.164455 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.164431    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228591 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228564    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228743 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228618    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228743 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228705    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228743 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228741    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228920 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228763    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnctt\" (UniqueName: \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.228920 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.228853    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.260779 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.260757    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"default-dockercfg-r5nv8\""
Oct 31 01:33:05.260906 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.260779    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Oct 31 01:33:05.260906 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.260797    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"kube-root-ca.crt\""
Oct 31 01:33:05.260906 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.260804    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"openshift-service-ca.crt\""
Oct 31 01:33:05.262180 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.262158    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:05.329438 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329414    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329563 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329461    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329563 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329492    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329563 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329518    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329563 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329550    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329772 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329579    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnctt\" (UniqueName: \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329872 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329854    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.329954 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329935    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.330008 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.329993    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.331792 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.331768    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.332011 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.331995    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.389104 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.389081    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnctt\" (UniqueName: \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\") pod \"rolling-upgrade-test-kserve-78f4d666cb-j7nxz\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.477827 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.477765    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:05.844289 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.844220    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:05.847299 ip-10-0-143-57 kubenswrapper[7559]: W1031 01:33:05.847266    7559 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b08f67_a28f_4eea_8024_643f353edeb9.slice/crio-106a780f3a803857f9d95c15fd9318c9a8ddb04f17771616603549def49b0b96 WatchSource:0}: Error finding container 106a780f3a803857f9d95c15fd9318c9a8ddb04f17771616603549def49b0b96: Status 404 returned error can't find the container with id 106a780f3a803857f9d95c15fd9318c9a8ddb04f17771616603549def49b0b96
Oct 31 01:33:05.922441 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.922407    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" event={"ID":"81b08f67-a28f-4eea-8024-643f353edeb9","Type":"ContainerStarted","Data":"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"}
Oct 31 01:33:05.922585 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:05.922456    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" event={"ID":"81b08f67-a28f-4eea-8024-643f353edeb9","Type":"ContainerStarted","Data":"106a780f3a803857f9d95c15fd9318c9a8ddb04f17771616603549def49b0b96"}
Oct 31 01:33:06.039326 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:06.039270    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" podStartSLOduration=1.039253931 podStartE2EDuration="1.039253931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:33:06.03877496 +0000 UTC m=+3790.413670180" watchObservedRunningTime="2026-10-31 01:33:06.039253931 +0000 UTC m=+3790.414149150"
Oct 31 01:33:06.478904 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:06.478870    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:07.236532 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:33:07.236492    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:33:08.366095 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:08.366065    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:08.438469 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:08.438434    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:33:08.635551 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:08.635469    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:33:08.943330 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:33:08.943290    7559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45" cmd=["/bin/sleep","15"]
Oct 31 01:33:08.943491 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:08.943345    7559 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 31 01:33:08.943491 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:33:08.943357    7559 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" containerName="main" containerID="cri-o://7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"
Oct 31 01:33:08.943491 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:08.943399    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" containerName="main" containerID="cri-o://7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45" gracePeriod=60
Oct 31 01:33:09.181052 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.181028    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:09.267402 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267349    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267402 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267391    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267437    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267483    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267503    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\" (UniqueName: \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267565 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267543    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\") pod \"81b08f67-a28f-4eea-8024-643f353edeb9\" (UID: \"81b08f67-a28f-4eea-8024-643f353edeb9\") "
Oct 31 01:33:09.267814 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267566    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:33:09.267814 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267759    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:33:09.267917 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267892    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:33:09.267981 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267904    7559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-home\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.267981 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.267944    7559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-model-cache\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.269823 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.269790    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "kube-api-access-xnctt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:33:09.269823 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.269814    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:33:09.269947 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.269915    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs" pod "81b08f67-a28f-4eea-8024-643f353edeb9" (UID: "81b08f67-a28f-4eea-8024-643f353edeb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:33:09.368984 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.368949    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b08f67-a28f-4eea-8024-643f353edeb9-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.368984 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.368977    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnctt\" (UniqueName: \"kubernetes.io/projected/81b08f67-a28f-4eea-8024-643f353edeb9-kube-api-access-xnctt\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.368984 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.368987    7559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-tmp-dir\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.369429 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.368998    7559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b08f67-a28f-4eea-8024-643f353edeb9-dshm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:33:09.939787 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.939752    7559 generic.go:356] "Generic (PLEG): container finished" podID="81b08f67-a28f-4eea-8024-643f353edeb9" containerID="7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45" exitCode=0
Oct 31 01:33:09.939929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.939796    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" event={"ID":"81b08f67-a28f-4eea-8024-643f353edeb9","Type":"ContainerDied","Data":"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"}
Oct 31 01:33:09.939929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.939833    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz" event={"ID":"81b08f67-a28f-4eea-8024-643f353edeb9","Type":"ContainerDied","Data":"106a780f3a803857f9d95c15fd9318c9a8ddb04f17771616603549def49b0b96"}
Oct 31 01:33:09.939929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.939853    7559 scope.go:122] "RemoveContainer" containerID="7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"
Oct 31 01:33:09.939929 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.939800    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"
Oct 31 01:33:09.948521 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.948370    7559 scope.go:122] "RemoveContainer" containerID="7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"
Oct 31 01:33:09.948660 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:33:09.948639    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45\": container with ID starting with 7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45 not found: ID does not exist" containerID="7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"
Oct 31 01:33:09.948709 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:09.948669    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45"} err="failed to get container status \"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45\": rpc error: code = NotFound desc = could not find container \"7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45\": container with ID starting with 7ad430bf5aebb177362a3259f1bfe418d010a53bd5c28d9e08c8806b4e987b45 not found: ID does not exist"
Oct 31 01:33:10.095591 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:10.095534    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:10.141853 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:10.141825    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-78f4d666cb-j7nxz"]
Oct 31 01:33:11.778158 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:11.778127    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" path="/var/lib/kubelet/pods/81b08f67-a28f-4eea-8024-643f353edeb9/volumes"
Oct 31 01:33:35.554194 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:35.554160    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:33:35.616351 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:35.616320    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:33:35.843532 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:35.843454    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:33:37.234293 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:33:37.234260    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:33:44.496862 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:44.496826    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:33:50.573746 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:50.573700    7559 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main" containerID="cri-o://e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23" gracePeriod=45
Oct 31 01:33:54.496897 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:54.496861    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:33:56.246925 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:33:56.246886    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:00.111466 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:00.111433    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:03.073610 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:03.073556    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:04.496156 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:04.496123    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:34:04.496532 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:04.496239    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:34:07.233674 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:34:07.233639    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:34:09.304759 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:09.304726    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:09.506331 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:09.506302    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:14.496684 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:14.496644    7559 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 01:34:20.813140 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:20.813113    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:34:20.971562 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:20.971535    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\" (UniqueName: \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\") pod \"7a81689e-a39c-4cda-8900-7c00e0b8f493\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") "
Oct 31 01:34:20.971737 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:20.971612    7559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\") pod \"7a81689e-a39c-4cda-8900-7c00e0b8f493\" (UID: \"7a81689e-a39c-4cda-8900-7c00e0b8f493\") "
Oct 31 01:34:20.973876 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:20.973842    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm" pod "7a81689e-a39c-4cda-8900-7c00e0b8f493" (UID: "7a81689e-a39c-4cda-8900-7c00e0b8f493"). InnerVolumeSpecName "kube-api-access-7q8dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:34:20.973982 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:20.973844    7559 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs" pod "7a81689e-a39c-4cda-8900-7c00e0b8f493" (UID: "7a81689e-a39c-4cda-8900-7c00e0b8f493"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:34:21.072711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.072686    7559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q8dm\" (UniqueName: \"kubernetes.io/projected/7a81689e-a39c-4cda-8900-7c00e0b8f493-kube-api-access-7q8dm\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:34:21.072711 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.072708    7559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a81689e-a39c-4cda-8900-7c00e0b8f493-tls-certs\") on node \"ip-10-0-143-57.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:34:21.239405 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.239319    7559 generic.go:356] "Generic (PLEG): container finished" podID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerID="e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23" exitCode=0
Oct 31 01:34:21.239405 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.239368    7559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"
Oct 31 01:34:21.239568 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.239412    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" event={"ID":"7a81689e-a39c-4cda-8900-7c00e0b8f493","Type":"ContainerDied","Data":"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"}
Oct 31 01:34:21.239568 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.239463    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx" event={"ID":"7a81689e-a39c-4cda-8900-7c00e0b8f493","Type":"ContainerDied","Data":"2f9bdc725b37d7ba8b07a3bc4e51c0d2127462a40d79696294e56824cf0fb382"}
Oct 31 01:34:21.239568 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.239484    7559 scope.go:122] "RemoveContainer" containerID="e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"
Oct 31 01:34:21.248452 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.248434    7559 scope.go:122] "RemoveContainer" containerID="e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"
Oct 31 01:34:21.248736 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:34:21.248718    7559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23\": container with ID starting with e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23 not found: ID does not exist" containerID="e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"
Oct 31 01:34:21.248799 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.248744    7559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23"} err="failed to get container status \"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23\": rpc error: code = NotFound desc = could not find container \"e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23\": container with ID starting with e5a795aeb5b1567f1483bd91d0c90bbe18b52d5b542a4f9be6a4e48d06645d23 not found: ID does not exist"
Oct 31 01:34:21.396140 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.396113    7559 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:34:21.442202 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.442172    7559 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-phklx"]
Oct 31 01:34:21.777956 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:21.777927    7559 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" path="/var/lib/kubelet/pods/7a81689e-a39c-4cda-8900-7c00e0b8f493/volumes"
Oct 31 01:34:37.234227 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:34:37.234190    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:34:37.423689 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:37.423652    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:43.134234 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:43.134197    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:43.328718 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:43.328680    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:44.857393 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:44.857355    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:51.237471 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:51.237432    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:51.432855 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:51.432824    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:52.023375 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:52.023344    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:34:52.224210 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:34:52.224185    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:35:00.458496 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:35:00.458464    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:35:07.233366 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:35:07.233330    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:35:37.233569 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:35:37.233527    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:35:55.096941 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:35:55.096909    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-fvvvx_dfe78532-2064-4c31-9ad2-c543c7f56f34/istio-proxy/0.log"
Oct 31 01:35:55.430893 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:35:55.430866    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-npztz_e98093bc-60db-4278-980b-5468949d6284/istio-proxy/0.log"
Oct 31 01:35:55.979554 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:35:55.979529    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-s86wq_f0fca93b-2386-4774-9340-022093872a5a/istio-proxy/0.log"
Oct 31 01:35:59.892981 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:35:59.892954    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-fvvvx_dfe78532-2064-4c31-9ad2-c543c7f56f34/istio-proxy/0.log"
Oct 31 01:36:00.103423 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:00.103394    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-npztz_e98093bc-60db-4278-980b-5468949d6284/istio-proxy/0.log"
Oct 31 01:36:00.528370 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:00.528343    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-568c495856-s86wq_f0fca93b-2386-4774-9340-022093872a5a/istio-proxy/0.log"
Oct 31 01:36:00.772392 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:00.772363    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:05.090873 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:05.090798    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-658c459c99-v5p56_8bd6518c-8473-4bc5-8bf5-13069ce2a458/manager/0.log"
Oct 31 01:36:05.251672 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:05.251645    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-2jggx_aba48895-ad53-41b5-bf42-c54e34e7e82f/limitador/0.log"
Oct 31 01:36:07.233843 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:36:07.233807    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:36:10.366731 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:10.366692    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:10.647251 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:10.647181    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:10.942919 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:10.942891    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:17.226885 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:17.226847    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:17.433714 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:17.433678    7559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log" limit=1024
Oct 31 01:36:20.362806 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:20.362777    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tpc6d_8c7eb1ae-0643-472e-a33c-4c7c3b88a266/global-pull-secret-syncer/0.log"
Oct 31 01:36:22.656675 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:22.656646    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g7bh6_cdc3eead-3ad0-46f2-b545-ec15921a2ab5/konnectivity-agent/0.log"
Oct 31 01:36:24.816409 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:24.816384    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-57.us-west-2.compute.internal_5a29509a616f19d20041e78e9796eaef/haproxy/0.log"
Oct 31 01:36:30.916846 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:30.916818    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-658c459c99-v5p56_8bd6518c-8473-4bc5-8bf5-13069ce2a458/manager/0.log"
Oct 31 01:36:31.275073 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:31.275003    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-2jggx_aba48895-ad53-41b5-bf42-c54e34e7e82f/limitador/0.log"
Oct 31 01:36:32.735655 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.735624    7559 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"]
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.735956    7559 cpu_manager.go:414] "containerMap: removing container" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main"
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.735967    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main"
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.736002    7559 cpu_manager.go:414] "containerMap: removing container" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" containerName="main"
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.736007    7559 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" containerName="main"
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.736053    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a81689e-a39c-4cda-8900-7c00e0b8f493" containerName="main"
Oct 31 01:36:32.736063 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.736067    7559 memory_manager.go:365] "RemoveStaleState removing state" podUID="81b08f67-a28f-4eea-8024-643f353edeb9" containerName="main"
Oct 31 01:36:32.738898 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.738881    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.788790 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.788769    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjbw9\"/\"kube-root-ca.crt\""
Oct 31 01:36:32.835246 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.835219    7559 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjbw9\"/\"default-dockercfg-jfw5t\""
Oct 31 01:36:32.835246 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.835234    7559 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjbw9\"/\"openshift-service-ca.crt\""
Oct 31 01:36:32.836413 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.836385    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"]
Oct 31 01:36:32.847353 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.847327    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-sys\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.847533 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.847504    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-proc\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.847660 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.847631    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-lib-modules\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.847796 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.847742    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-podres\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.847923 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.847899    7559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq47s\" (UniqueName: \"kubernetes.io/projected/ac721d85-0901-4a19-b44d-c7bd1475cbd5-kube-api-access-bq47s\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949163 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949135    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-lib-modules\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949294 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949185    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-podres\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949294 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949218    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq47s\" (UniqueName: \"kubernetes.io/projected/ac721d85-0901-4a19-b44d-c7bd1475cbd5-kube-api-access-bq47s\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949294 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949271    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-lib-modules\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949294 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949277    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-sys\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949480 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949324    7559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-proc\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949480 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949327    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-sys\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949480 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949326    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-podres\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:32.949480 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:32.949388    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac721d85-0901-4a19-b44d-c7bd1475cbd5-proc\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:33.009299 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.009244    7559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq47s\" (UniqueName: \"kubernetes.io/projected/ac721d85-0901-4a19-b44d-c7bd1475cbd5-kube-api-access-bq47s\") pod \"perf-node-gather-daemonset-b72w2\" (UID: \"ac721d85-0901-4a19-b44d-c7bd1475cbd5\") " pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:33.050772 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.050755    7559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:33.413903 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.413872    7559 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"]
Oct 31 01:36:33.788301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.788232    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2" event={"ID":"ac721d85-0901-4a19-b44d-c7bd1475cbd5","Type":"ContainerStarted","Data":"29f1b7341df4a12dce315716f4c0f0cec9b7c075db78ba99bbb73f9128deb0f2"}
Oct 31 01:36:33.788301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.788276    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:33.788301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.788292    7559 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2" event={"ID":"ac721d85-0901-4a19-b44d-c7bd1475cbd5","Type":"ContainerStarted","Data":"793592e1f2af21e253e147f21188e94ca661d8a02fad13c76280884897efb8a9"}
Oct 31 01:36:33.899200 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:33.899151    7559 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2" podStartSLOduration=1.899136929 podStartE2EDuration="1.899136929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:36:33.89896816 +0000 UTC m=+3998.273863382" watchObservedRunningTime="2026-10-31 01:36:33.899136929 +0000 UTC m=+3998.274032189"
Oct 31 01:36:37.233897 ip-10-0-143-57 kubenswrapper[7559]: E1031 01:36:37.233859    7559 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dggrt" containerName="extractor"
Oct 31 01:36:37.483140 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:37.483111    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-gpzd2_611b4aab-bbce-4c31-8074-f79ff52f2cd1/kube-state-metrics/0.log"
Oct 31 01:36:37.888099 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:37.888070    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-gpzd2_611b4aab-bbce-4c31-8074-f79ff52f2cd1/kube-rbac-proxy-main/0.log"
Oct 31 01:36:38.297111 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:38.297086    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-gpzd2_611b4aab-bbce-4c31-8074-f79ff52f2cd1/kube-rbac-proxy-self/0.log"
Oct 31 01:36:38.709949 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:38.709916    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-767548898d-bt8ls_639d9b02-4e18-4090-905b-8ca6d4d8352a/metrics-server/0.log"
Oct 31 01:36:39.125264 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:39.125196    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-w72zc_fbff7817-a278-44aa-bb7d-5aacdbf7d4ac/monitoring-plugin/0.log"
Oct 31 01:36:39.802250 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:39.802225    7559 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjbw9/perf-node-gather-daemonset-b72w2"
Oct 31 01:36:42.017141 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:42.017114    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwdtq_8bcc5163-4382-4160-b05b-b6f745faafdb/node-exporter/0.log"
Oct 31 01:36:42.426937 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:42.426913    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwdtq_8bcc5163-4382-4160-b05b-b6f745faafdb/kube-rbac-proxy/0.log"
Oct 31 01:36:42.839671 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:42.839646    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwdtq_8bcc5163-4382-4160-b05b-b6f745faafdb/init-textfile/0.log"
Oct 31 01:36:43.254252 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:43.254204    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-4czgl_8bff60fc-622d-4b2d-a935-537b4e9c3ae2/kube-rbac-proxy-main/0.log"
Oct 31 01:36:43.667039 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:43.667015    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-4czgl_8bff60fc-622d-4b2d-a935-537b4e9c3ae2/kube-rbac-proxy-self/0.log"
Oct 31 01:36:44.084380 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:44.084295    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-4czgl_8bff60fc-622d-4b2d-a935-537b4e9c3ae2/openshift-state-metrics/0.log"
Oct 31 01:36:44.509064 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:44.509034    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/prometheus/0.log"
Oct 31 01:36:44.926322 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:44.926269    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/config-reloader/0.log"
Oct 31 01:36:45.340312 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:45.340233    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/thanos-sidecar/0.log"
Oct 31 01:36:45.750549 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:45.750520    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/kube-rbac-proxy-web/0.log"
Oct 31 01:36:46.164803 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:46.164778    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/kube-rbac-proxy/0.log"
Oct 31 01:36:46.575549 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:46.575474    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/kube-rbac-proxy-thanos/0.log"
Oct 31 01:36:46.988176 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:46.988145    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da9dbd75-bdb0-43ec-8f79-63b574105c0e/init-config-reloader/0.log"
Oct 31 01:36:47.404228 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:47.404204    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-x6fw4_dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/prometheus-operator/0.log"
Oct 31 01:36:47.812301 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:47.812234    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-x6fw4_dafad05c-abe0-4a45-a8f4-b3ffb5aaf055/kube-rbac-proxy/0.log"
Oct 31 01:36:48.644011 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:48.643984    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566b5dddf-4lwr4_77822f8f-dc1d-4774-99dd-673286558e56/telemeter-client/0.log"
Oct 31 01:36:49.055560 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:49.055530    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566b5dddf-4lwr4_77822f8f-dc1d-4774-99dd-673286558e56/reload/0.log"
Oct 31 01:36:49.465657 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:49.465633    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566b5dddf-4lwr4_77822f8f-dc1d-4774-99dd-673286558e56/kube-rbac-proxy/0.log"
Oct 31 01:36:49.881573 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:49.881498    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/thanos-query/0.log"
Oct 31 01:36:50.294102 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:50.294073    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/kube-rbac-proxy-web/0.log"
Oct 31 01:36:50.708512 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:50.708484    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/kube-rbac-proxy/0.log"
Oct 31 01:36:51.118183 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:51.118111    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/prom-label-proxy/0.log"
Oct 31 01:36:51.528616 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:51.528574    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/kube-rbac-proxy-rules/0.log"
Oct 31 01:36:51.940367 ip-10-0-143-57 kubenswrapper[7559]: I1031 01:36:51.940337    7559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554698664c-x6vzb_cf645cc8-1325-4315-94b3-470599cf28e8/kube-rbac-proxy-metrics/0.log"